-- Logs begin at Sun 2022-07-31 19:13:39 UTC, end at Sun 2022-07-31 20:15:27 UTC. -- Jul 31 19:50:45.681426 dv-cinder-849846-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 31 19:50:45.689638 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 31 19:50:45.692166 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 31 19:50:45 2022] *** Jul 31 19:50:45.692306 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 31 19:50:45.692412 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 31 19:50:45.692501 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: nodename: dv-cinder-849846-6-iscsi Jul 31 19:50:45.692585 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: machine: x86_64 Jul 31 19:50:45.692671 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: clock source: unix Jul 31 19:50:45.692762 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: pcre jit disabled Jul 31 19:50:45.692857 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: detected number of CPU cores: 4 Jul 31 19:50:45.692945 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: current working directory: / Jul 31 19:50:45.693029 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: detected binary path: /usr/bin/uwsgi-core Jul 31 19:50:45.693117 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: your processes number limit is 47680 Jul 31 19:50:45.693231 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: your memory page size is 4096 bytes Jul 31 19:50:45.693321 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: detected max file descriptor number: 2048 Jul 31 19:50:45.693424 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: lock engine: pthread robust mutexes Jul 31 19:50:45.693678 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: thunder lock: enabled Jul 31 19:50:45.693991 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 31 19:50:45.694119 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 31 19:50:45.732394 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: Python main interpreter initialized at 0x5583b7a139c0 Jul 31 19:50:45.732394 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: python threads support enabled Jul 31 19:50:45.732394 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: your server socket listen backlog is limited to 100 connections Jul 31 19:50:45.732394 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: your mercy for graceful operations on workers is 90 seconds Jul 31 19:50:45.732765 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: mapped 403077 bytes (393 KB) for 2 cores Jul 31 19:50:45.732765 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: *** Operational MODE: preforking *** Jul 31 19:50:45.733053 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: *** uWSGI is running in multiple interpreter mode *** Jul 31 19:50:45.733053 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: spawned uWSGI master process (pid: 103251) Jul 31 19:50:45.733286 dv-cinder-849846-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 31 19:50:45.736808 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: spawned uWSGI worker 1 (pid: 103252, cores: 1) Jul 31 19:50:45.736808 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: spawned uWSGI worker 2 (pid: 103253, cores: 1) Jul 31 19:50:45.736808 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 31 19:50:46.377519 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 19:50:46.378111 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 19:50:47.439104 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 19:50:47.439104 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: from cryptography.utils import int_from_bytes Jul 31 19:50:47.439702 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 19:50:47.439702 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: from cryptography.utils import int_from_bytes Jul 31 19:50:47.441734 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 19:50:47.441734 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: from cryptography.utils import int_from_bytes Jul 31 19:50:47.442242 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 19:50:47.442242 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: from cryptography.utils import int_from_bytes Jul 31 19:50:49.881797 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 19:50:49.882513 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 19:50:49.882513 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 19:50:49.882923 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 19:50:49.883068 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 19:50:49.883447 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 19:50:49.883536 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 19:50:49.883606 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.883752 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 19:50:49.883912 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.884080 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 19:50:49.884180 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.884357 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 19:50:49.884499 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.884727 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.884858 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.885009 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.885112 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.885374 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.885523 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.885683 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.885813 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.886007 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.886128 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.886219 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.886300 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.886556 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.886691 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.886850 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-6-iscsi {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.886941 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.887193 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.887350 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.887432 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.887500 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.887701 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.887791 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.888025 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-6-iscsi {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.888113 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.888336 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.888423 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.888641 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.888729 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.888920 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.889010 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.889260 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.889461 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.890718 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.890718 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.890965 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.891122 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.891251 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.891251 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.891498 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.891641 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.891762 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.891880 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.891998 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.892121 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.892258 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.892383 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.892501 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.892620 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.892744 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.892862 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.892988 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.893106 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.893247 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.893377 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-6-iscsi {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.893511 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.893631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.893754 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.893872 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.893989 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.894117 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.894237 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-6-iscsi {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.894364 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.894484 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.894685 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.894808 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.894946 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.895072 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.895202 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.895349 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.895470 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.895588 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.895712 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.895831 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.896000 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.896134 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.896324 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.896450 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.896636 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.896763 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.896946 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.897080 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.897281 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.897408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.897578 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.897703 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.897892 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.898030 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.898197 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.898322 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.898527 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.898661 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.898820 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.898947 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.899151 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.899282 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.899403 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.899533 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.899653 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.899771 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.899922 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.900047 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.900232 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.900367 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.900499 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.900620 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.900738 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.900868 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.901028 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.901175 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.901374 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.901502 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.901622 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.901758 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.901908 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.902044 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.902227 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.902353 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.902511 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.902645 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.902822 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.902954 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.903112 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.903237 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.903421 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.903562 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.903691 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.903810 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.903989 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.904123 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.904280 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.904406 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.904579 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.904705 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.904888 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.905022 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.905187 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.905320 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.905514 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.905639 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.905807 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.905932 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.906112 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.906238 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.906443 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.906570 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.906689 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.906807 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.907001 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.907127 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.907331 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.907457 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.907637 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.907762 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.907939 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.908064 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.908244 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.908412 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.908536 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.908665 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.908821 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.908944 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.909109 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.909340 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.909473 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.909608 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.909728 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.909845 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.909969 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.910088 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.910265 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.910401 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.910531 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.910649 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.910827 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.910952 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.911108 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.911242 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.911428 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.911556 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.911722 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.911853 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.911988 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.912107 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.912299 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.912425 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.912598 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.912724 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.912855 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.912975 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.913183 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.913309 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.913502 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.913641 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.913769 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.913888 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.914106 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.914231 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.914415 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.914540 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.914696 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.914828 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.915001 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.915135 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.915283 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.915408 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.915595 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.915725 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.915891 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.916030 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.916179 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.916310 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.916472 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.916597 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.916779 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.916946 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.917068 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.917246 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.917380 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.917500 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.917681 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.917807 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.917975 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.918098 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.918300 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.918427 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.918547 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.918664 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.918861 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.918999 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.919148 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.919273 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.919472 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.919594 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.919712 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.919846 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.920027 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.920153 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.920323 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.920446 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.920617 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.920751 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.920873 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.920998 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.921194 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.921321 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.921500 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.921657 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.921779 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.921896 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.922074 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.922198 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.922367 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.922501 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.922649 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.922773 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.922946 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.923081 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.923209 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.923334 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.923514 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.923639 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.923818 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.923954 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.924112 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.924236 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.924419 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.924549 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.924740 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.924866 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.924993 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.925121 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.925326 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:50:49.925452 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.925654 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.925792 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.925976 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.926103 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.926309 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.926434 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.926620 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.926753 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.926940 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.927063 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.927252 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.927378 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.927545 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.927675 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.927848 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.927967 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.928156 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.928284 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.928448 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.928567 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.928759 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.928881 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.929061 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.929203 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.929389 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.929590 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.929769 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.929900 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.930051 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.930182 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.930366 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.930495 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.930672 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.930803 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.930979 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.931099 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.931291 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.931414 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.931596 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.931717 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.931902 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.932022 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.932221 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.932350 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.932535 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.932658 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.932838 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.932970 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.933180 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.933305 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.933507 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.933630 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.933816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.933939 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.934126 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.934249 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.934432 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.934568 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.934734 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.934867 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.935037 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.935166 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.935338 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.935461 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.935651 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.935782 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.935956 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.936084 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.936263 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.936393 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.936568 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.936698 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.936871 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.936992 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.937191 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.937314 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.937497 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.937635 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.937799 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.937921 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.938101 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.938224 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.938419 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.938553 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.938726 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.938855 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.939033 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.939162 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.939334 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.939455 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.939666 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.939806 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.939942 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.940070 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.940280 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.940410 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.940530 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.940656 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.940778 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.940895 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.941069 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.941223 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.941386 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.941509 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.941689 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.941811 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.941975 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.942107 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.942288 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.942412 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.942604 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.942739 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.942902 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.943036 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.943208 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.943335 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.943509 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.943639 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.943806 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.943927 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.944103 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.944232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.944403 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.944539 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.944696 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.944819 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.944996 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.945126 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.945341 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.945496 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.945640 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.945771 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.945958 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.946117 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.946257 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.946385 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.946544 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.946667 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.946858 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.946994 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.947162 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.947285 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.947469 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.947602 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.947774 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.947896 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.948079 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.948210 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.948389 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.948519 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.948695 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.948816 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.949004 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.949126 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.949357 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.949481 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.949685 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.949895 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.950019 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.950137 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.950290 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.950413 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.950609 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.950740 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.950905 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.951032 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.951212 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.951334 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.951517 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.951648 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.951819 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.951942 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.952112 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.952233 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.952413 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.952548 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.952709 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.952829 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.953005 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.953130 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.953323 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.953447 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.953622 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.953742 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.953915 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.954035 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.954212 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.954343 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.954506 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.954629 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.954800 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.954923 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.955097 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.955220 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.955394 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.955515 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.955693 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.955823 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.955988 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.956109 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.956283 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.956405 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.956580 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.956711 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.956913 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.957035 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.957230 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.957354 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.957563 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.957703 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.957878 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.957998 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.958187 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.958306 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.958490 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.958620 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.958796 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.958926 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.959099 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.959220 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.959398 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.959528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.959700 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.959831 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.960035 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.960158 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.960290 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.960409 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.960588 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.960712 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.960931 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.961052 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.961259 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.961381 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.961568 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.961689 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.961867 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.961987 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.962172 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.962292 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.962484 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.962606 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.962780 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.962912 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.963086 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.963209 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.963413 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.963534 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.963722 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.963848 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.964031 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.964154 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.964335 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.964455 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.964634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.964769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.964937 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.965065 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.965256 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.965378 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.965559 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.965691 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.965861 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.965984 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.966162 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.966290 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.966464 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.966592 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.966763 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.966883 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.967068 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.967188 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.967367 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.967500 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.967666 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.967787 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.967965 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.968087 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.968282 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.968415 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.968562 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.968685 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.968868 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.968991 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.969205 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.969331 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.969523 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.969646 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.969825 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.969945 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.970156 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.970280 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.970408 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.970529 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.970710 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.970832 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.971010 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.971138 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.971311 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.971431 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.971606 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.971735 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.971903 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.972026 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.972206 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.972327 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.972505 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.972636 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.972806 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.972927 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.973108 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.973245 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.973429 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.973565 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.973726 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.973847 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.974023 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.974144 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.974321 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.974457 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.974617 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.974739 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.974922 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.975045 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.975234 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.975356 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.975534 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.975663 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.975833 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.975956 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.976143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.976265 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.976437 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.976626 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.976779 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.976902 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.977079 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.977251 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.977427 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.977575 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.977709 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.977913 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.978045 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.978220 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.978342 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.978522 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.978654 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.978834 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.978966 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.979151 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.979274 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.979455 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.979579 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.979765 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.979896 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.980066 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.980262 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.980394 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.980514 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.980642 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.980761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.980945 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.981067 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.981278 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.981402 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.981585 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.981710 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.981885 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.982006 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.982186 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.982309 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.982486 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.982607 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.982785 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.982914 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.983083 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.983222 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.983386 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.983507 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.983686 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.983814 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.983981 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.984119 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.984280 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.984408 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.984575 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.984698 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.984873 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.985145 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.985319 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.985497 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.985747 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.985870 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.986077 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.986217 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.986391 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.986513 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.986706 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.986835 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.987022 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.987154 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.987335 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.987465 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.987659 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.987783 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.987960 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.988098 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.988267 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.988390 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.988570 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.988701 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.988871 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.988993 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.989184 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.989321 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.989487 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.989609 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.989789 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.989916 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.990090 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.990210 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.990408 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.990529 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.990675 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.990795 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.990972 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.991095 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.991267 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.991388 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.991564 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.991684 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.991888 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.992017 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.992162 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.992282 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.992461 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.992583 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.992757 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.992879 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.993060 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.993199 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.993385 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.993519 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.993684 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.993807 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.993982 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.994105 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.994276 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.994405 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.994571 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.995044 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.995222 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.995353 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.995555 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.995687 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.995853 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.995975 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.996183 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.996305 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.996482 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.996606 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.996783 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.996907 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.997102 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.997269 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.997423 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.997552 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.997722 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.997843 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.998019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.998139 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.998320 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.998451 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.998618 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.998740 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.998912 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.999044 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.999209 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.999330 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.999502 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.999625 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.999804 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:49.999932 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.000101 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.000229 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.000462 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.000594 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.000714 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.000840 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.000960 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.001079 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.001286 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.001418 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.001581 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.001713 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.001879 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.001999 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.002175 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.002303 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.002468 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.002599 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.002760 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.002883 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.003056 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.003176 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.003350 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.003471 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.003641 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.003765 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.003938 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.004061 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.004231 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.004355 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.004527 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.004657 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.004820 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.004940 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.005114 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.005281 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.005431 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.005566 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.005726 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.005857 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.006023 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.006144 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.006315 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.006438 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.006612 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.006741 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.006909 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.007031 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.007202 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.007332 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.007495 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.007624 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.007838 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.007963 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.008142 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.008262 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.008446 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.008681 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.008860 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.009022 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.009022 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.009317 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.009460 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.009636 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.009785 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.009963 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.010105 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.010233 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.010335 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.010470 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.010605 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.010746 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.010889 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.011029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.011189 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.011315 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.011315 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.011468 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.011629 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.011853 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.012062 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.012244 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.012244 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.012626 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.012819 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.013000 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.013138 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.013330 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.013503 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.013694 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.013884 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.014091 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.014284 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.014491 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.014687 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.014878 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.015059 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.015284 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.015504 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.015698 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.015874 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.016000 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.016128 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.016258 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.016379 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.016505 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.016625 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.016743 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.016869 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.016999 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.017223 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.017441 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.017633 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.017824 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.018019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.018232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.018432 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.018615 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.018615 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.018953 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.019086 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.019207 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.019326 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.019456 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.019583 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.019703 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.019834 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.019956 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.020154 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.020276 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.020276 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.020511 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.020791 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.020918 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.020918 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.021142 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.021308 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.021442 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.021577 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.021697 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.021697 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.021920 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.022039 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.022166 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.022276 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.022398 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.022517 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.022643 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.022769 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.022897 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.023026 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.023145 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.023264 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.023406 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.023526 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.023655 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.023775 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.023893 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.024019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.024139 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.024269 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.024402 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.024522 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.024691 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.024820 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.024947 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.025076 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.025210 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.025331 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.025461 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.025582 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.025701 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.025828 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.025948 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.026075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.026194 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.026321 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.026448 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.026576 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.026696 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.026815 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.026940 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.027060 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.027178 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.027304 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.027409 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.027511 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.027613 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.027802 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.027923 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.028111 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.028271 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.028499 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.028736 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.028865 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.029092 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.029220 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.029376 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.029527 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.029677 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.029822 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.030085 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.030284 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.030394 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.030496 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.030684 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.030873 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.030990 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.031095 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.031272 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.031382 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.031568 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.031686 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.031865 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.031982 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.032765 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.032890 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.032890 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.033134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.033281 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.033401 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.033520 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.033653 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.033785 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.033905 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.034024 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.034144 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.034262 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.034380 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.034507 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.034626 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.034745 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.034862 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.034980 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.035105 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.035295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.035417 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.035600 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.035723 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.035901 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.036032 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.036216 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.036346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.036529 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.036660 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.036870 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.037006 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.037128 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.037282 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.037450 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.037573 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.037753 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.037875 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.038061 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.038191 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.038364 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.038488 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.038671 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.038791 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.039501 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.039651 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.039761 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.039864 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.039973 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.040078 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.040189 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.040312 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.040487 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.040603 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.040707 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.040809 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.041002 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.041114 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.041244 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.041349 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.041533 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.041643 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.043937 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.044099 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.044099 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.044347 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.044471 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.044607 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.044740 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.044862 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.044862 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.045099 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.045290 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.045426 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.045547 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.045676 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.045797 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.045915 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.046034 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.046181 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.046303 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.046422 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.046549 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.046675 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.046795 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.046926 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.047047 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.047166 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.047292 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.047420 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.047540 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.047667 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.047789 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.047915 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.048035 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.048156 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.048284 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.048411 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.048530 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.048649 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.048768 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.048887 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.049015 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.049202 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.049325 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.049445 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.049667 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.049793 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.049929 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.050050 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.050171 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.050289 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.050417 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.050553 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.050681 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.050813 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.050934 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.051132 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.051256 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.051385 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.051505 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.051624 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.051743 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.051862 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.051990 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.052119 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.052246 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.052367 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.052485 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.052603 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.052722 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.052850 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.052973 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.053092 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.053268 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.053388 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.053506 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.053637 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.053762 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.053881 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.054000 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.054127 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.054259 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.054379 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.054497 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.054638 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.054767 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.054888 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.055017 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.055137 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.055256 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.055374 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.055501 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.055621 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.055749 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.055870 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.055988 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.056106 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.056225 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.056352 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.056481 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.056608 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.056728 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.056846 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.056964 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.057180 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.057316 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.057437 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.057555 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.057675 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.057802 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.057931 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.058059 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.058178 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.058381 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.058513 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.058693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.058826 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.059008 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.059130 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.059326 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.059448 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.059634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.059776 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.059942 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.060065 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.060252 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.060386 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.060560 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.060689 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.060868 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.060991 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.061196 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.061340 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.061504 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.061634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.061811 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.061933 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.062117 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.062238 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.062417 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.062541 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.062723 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.062956 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.063079 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.063279 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.063412 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.063591 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.063845 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.063977 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.064169 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.064301 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.064480 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.064605 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.064785 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.064906 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.065089 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.065247 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.065421 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.065542 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.065725 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.065846 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.066027 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.066157 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.066329 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.066457 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.066632 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.066763 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.066934 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.067058 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.067254 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.067377 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.067568 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.067694 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.067877 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.067999 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.068187 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.068319 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.068496 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.068619 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.068802 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.068924 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.069108 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.069250 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.069442 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.069582 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.069744 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.069865 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.070047 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.070170 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.070413 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.070549 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.070719 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.070841 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.071023 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.071146 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.071333 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.071445 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.071640 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.071736 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.071941 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.072045 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.072243 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.072337 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.072548 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.072651 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.072852 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.072950 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.073223 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.073322 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.073475 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.073578 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.073780 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.073877 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.074095 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.074181 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.074417 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.074504 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.074729 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.074825 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.075036 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.075252 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.075339 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.075562 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.075648 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.075889 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.076125 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.076212 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.076428 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.076514 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.076750 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.076837 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.077064 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.077179 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.077401 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.077489 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.077709 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.077797 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.078019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.078106 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.078322 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.078407 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.078626 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.078712 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.078923 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.079008 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.079223 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.079309 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.079522 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.079610 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.079830 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.079916 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.080125 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.080219 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.080425 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.080511 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.080719 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.080952 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.081051 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.081320 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.081411 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.081634 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.081845 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.081953 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.082187 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.082284 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.082495 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.082583 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.082811 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.082913 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.083129 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.083224 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.083438 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.083526 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.083736 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.083835 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.084043 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.084131 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.084338 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.084423 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.084636 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.084723 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.084936 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.085026 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.085256 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.085357 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.085555 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.085642 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.085870 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.085960 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.086173 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.086261 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.086469 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.086555 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.086762 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.086848 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.087058 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.087145 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.087352 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.087452 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.087648 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.087734 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.087952 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.088039 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.088245 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.088342 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.088539 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.088634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.088837 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.088922 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.089130 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.089249 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.089443 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.089529 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.089741 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.089828 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.090032 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.090130 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.090333 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.090418 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.090623 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.090709 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.090939 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.091023 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.091214 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.091299 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.091514 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.091596 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.091812 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.091907 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.092110 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.092196 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.092425 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.092518 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.092735 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.092830 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.093034 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.093120 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.093354 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.093436 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.093658 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.093746 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.093959 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.094046 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.094271 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.094365 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.094577 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.094676 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.094878 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.095106 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.095219 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.095438 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.095525 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.095757 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.096041 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.096128 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.096374 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.096473 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.096689 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.096781 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.096991 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.097085 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.097315 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.097421 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.097635 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.097723 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.097931 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.098015 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.098229 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.098316 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.098531 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.098624 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.098838 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.098937 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.099139 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.099226 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.099442 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.099528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.099743 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.099830 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.100044 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.100128 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.100346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.100434 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.100649 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.100743 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.100948 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.101038 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.101270 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.101360 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.101625 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.101720 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.101926 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.102013 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.102228 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.102316 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.102529 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.102628 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.102830 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.102929 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.103136 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.103222 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.103459 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.103546 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.103769 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.103860 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.104072 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.104159 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.104378 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.104467 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.104683 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.104771 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.104982 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.105068 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.105304 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.105395 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.105607 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.105694 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.105906 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.105994 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.106210 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.106296 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.106529 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.106617 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.106835 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.106931 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.107133 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.107220 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.107513 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.107598 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.107819 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.107915 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.108125 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.108212 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.108441 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.108527 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.108742 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.108840 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.109054 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.109140 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.109387 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.109475 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.109690 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.109777 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.110004 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.110090 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.110309 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.110395 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.110630 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.110719 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.110939 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.111035 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.111240 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.111326 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.111541 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.111629 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.111846 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.111933 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.112142 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.112241 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.112439 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.112526 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.112740 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.112828 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.113039 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.113134 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.113368 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.113454 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.113666 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.113752 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.114036 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.114229 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.114309 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.114383 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.114563 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.114653 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.114843 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.114944 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.115140 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.115243 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.115434 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.115529 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.115729 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.115815 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.116020 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.116105 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.116315 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.116402 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.116607 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.116695 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.116900 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.116987 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.117239 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.117331 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.117538 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.117625 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.117834 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.117920 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.118127 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.118213 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.118433 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.118522 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.118729 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.118816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.119024 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.119121 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.119317 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.119404 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.120002 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.120097 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.120326 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.120421 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.120634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.120721 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.120950 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.121037 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.121280 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.121383 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.121585 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.121681 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.121887 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.121985 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.122191 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.122290 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.122502 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.122588 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.122808 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.122894 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.123108 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.123196 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.123411 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.123544 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.123719 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.123806 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.124022 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.124109 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.124326 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.124420 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.124677 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.124772 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.124930 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.125018 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.125252 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.125344 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.125571 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.125670 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.125884 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.125970 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.126184 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.126272 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.126495 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.126593 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.126802 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.126889 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.127113 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.127199 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.127419 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.127513 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.127720 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.127806 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.128023 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.128115 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.128328 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.128416 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.128636 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.128771 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.128930 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.129017 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.129261 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.129363 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.129559 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.129646 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.129868 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.129953 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.130172 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.130259 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.130476 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.130562 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.130785 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.130880 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.131095 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.131183 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.131416 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.131500 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.131731 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.131871 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.132033 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.132121 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.132350 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.132437 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.132670 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.132767 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.133054 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.133142 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.133381 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.133478 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.133686 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.133785 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.133986 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.134073 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.134224 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 19:50:50.134311 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.134604 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.134903 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:50:50.135141 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 19:50:50.290442 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO dbcounter [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] Registered counter for database nova_api Jul 31 19:50:50.290702 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO dbcounter [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] Registered counter for database nova_api Jul 31 19:50:50.313232 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:50:50.315422 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_db.sqlalchemy.engines [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:50:50.320391 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writer thread running {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:50:50.322259 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writer thread running {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:50:50.375009 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.context [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cdcc5c53-df39-4ee3-bc4a-be549d4d611a(cell1) {{(pid=103252) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 19:50:50.376750 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.context [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cdcc5c53-df39-4ee3-bc4a-be549d4d611a(cell1) {{(pid=103253) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 19:50:50.378964 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:50:50.380550 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:50:50.380682 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:50:50.381351 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:50:50.382372 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:50:50.383119 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:50:50.383349 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:50:50.385085 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:50:50.385299 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO dbcounter [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] Registered counter for database nova_cell0 Jul 31 19:50:50.387091 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO dbcounter [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] Registered counter for database nova_cell0 Jul 31 19:50:50.390664 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO dbcounter [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] Registered counter for database nova_cell1 Jul 31 19:50:50.392448 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO dbcounter [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] Registered counter for database nova_cell1 Jul 31 19:50:50.399220 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:50:50.401387 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:50:50.402757 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_db.sqlalchemy.engines [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:50:50.405285 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writer thread running {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:50:50.406236 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_db.sqlalchemy.engines [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:50:50.409101 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writer thread running {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:50:50.538161 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writer thread running {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:50:50.543706 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writer thread running {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:50:50.548372 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO dbcounter [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] Registered counter for database nova_cell0 Jul 31 19:50:50.552826 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO dbcounter [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] Registered counter for database nova_cell0 Jul 31 19:50:50.555448 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:50:50.560863 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writer thread running {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:50:50.562643 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_db.sqlalchemy.engines [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:50:50.569175 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writer thread running {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:50:50.894909 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: WARNING keystonemiddleware.auth_token [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 19:50:50.898715 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: WARNING keystonemiddleware.auth_token [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 19:50:50.902202 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: WARNING keystonemiddleware.auth_token [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 19:50:50.905889 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: WARNING keystonemiddleware.auth_token [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 19:50:51.244387 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: WARNING keystonemiddleware.auth_token [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 19:50:51.248012 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: WARNING keystonemiddleware.auth_token [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 19:50:51.250606 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: WARNING keystonemiddleware.auth_token [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 19:50:51.253988 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: WARNING keystonemiddleware.auth_token [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 19:50:51.255852 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5583b7a139c0 pid: 103252 (default app) Jul 31 19:50:51.258004 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:50:51.259183 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-2a6862d6-96c5-4734-95de-bbd33651a683 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001806 Jul 31 19:50:51.259317 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5583b7a139c0 pid: 103253 (default app) Jul 31 19:50:51.259564 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Sun Jul 31 19:50:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:52:06.685921 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:06.687145 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Jul 31 19:52:06.687519 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:52:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:52:06.698929 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_api:SELECT=3 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:52:06.699862 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_cell0:SELECT=3 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:52:06.700949 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_cell1:SELECT=3 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:52:06.702216 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:52:07.578132 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-33f27fac-d939-4c50-b150-b3a703a0341e admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:07.611127 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-33f27fac-d939-4c50-b150-b3a703a0341e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917554 Jul 31 19:52:07.612017 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 2/3] 10.222.0.48 () {60 vars in 1291 bytes} [Sun Jul 31 19:52:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 19:52:09.800758 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:09.802309 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-b8bec1d9-e4c6-47b4-b032-db0ddb9ea42b None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002103 Jul 31 19:52:09.805333 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 2/4] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:52:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:52:10.258154 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-98fcd4b0-4d8b-491f-bc9f-c048d93a9ef7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "id": "c1", "vcpus": 1}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:10.281215 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 19:52:10.281215 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: warnings.warn(msg) Jul 31 19:52:10.312947 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-98fcd4b0-4d8b-491f-bc9f-c048d93a9ef7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.503842 Jul 31 19:52:10.313686 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 3/5] 10.222.0.48 () {64 vars in 1282 bytes} [Sun Jul 31 19:52:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 19:52:10.327312 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_api:SELECT=3 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:52:10.328295 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_cell0:SELECT=3 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:52:10.329713 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_cell1:SELECT=3 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:52:10.331072 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:52:10.529703 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-2b743b5a-aaf5-472b-9da7-0f1df45a1dd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:10.534126 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 19:52:10.534126 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: warnings.warn(msg) Jul 31 19:52:10.606262 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-2b743b5a-aaf5-472b-9da7-0f1df45a1dd3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283905 Jul 31 19:52:10.607050 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 3/6] 10.222.0.48 () {64 vars in 1335 bytes} [Sun Jul 31 19:52:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:52:12.807829 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-98fcd4b0-4d8b-491f-bc9f-c048d93a9ef7 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:12.809617 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-98fcd4b0-4d8b-491f-bc9f-c048d93a9ef7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002259 Jul 31 19:52:12.810272 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 4/7] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:52:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:52:13.456964 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-8442e1d4-8d7e-4b5c-bdda-e8240b26a7df admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M", "ram": 512, "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:13.479379 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 19:52:13.479379 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: warnings.warn(msg) Jul 31 19:52:13.500846 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-8442e1d4-8d7e-4b5c-bdda-e8240b26a7df admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.684173 Jul 31 19:52:13.508558 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 4/8] 10.222.0.48 () {64 vars in 1282 bytes} [Sun Jul 31 19:52:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 19:52:13.513655 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-991c8cfb-686d-47f3-8476-50e14b06ff83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:13.516679 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 19:52:13.516679 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: warnings.warn(msg) Jul 31 19:52:13.552367 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-991c8cfb-686d-47f3-8476-50e14b06ff83 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042360 Jul 31 19:52:13.553252 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 5/9] 10.222.0.48 () {64 vars in 1335 bytes} [Sun Jul 31 19:52:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 19:52:15.715549 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-8442e1d4-8d7e-4b5c-bdda-e8240b26a7df admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:15.716595 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-8442e1d4-8d7e-4b5c-bdda-e8240b26a7df admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 31 19:52:15.717063 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:52:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:52:16.142089 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-20de7120-a317-4950-8dc7-3283d59de850 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:16.163200 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-20de7120-a317-4950-8dc7-3283d59de850 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439828 Jul 31 19:52:16.171020 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 6/11] 10.222.0.48 () {64 vars in 1282 bytes} [Sun Jul 31 19:52:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 19:52:16.176150 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-1576c11f-dd2d-41fd-a0b0-7889edd66d41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:16.200621 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-1576c11f-dd2d-41fd-a0b0-7889edd66d41 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028239 Jul 31 19:52:16.201101 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 6/12] 10.222.0.48 () {64 vars in 1335 bytes} [Sun Jul 31 19:52:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:52:18.379442 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-20de7120-a317-4950-8dc7-3283d59de850 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:18.380456 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-20de7120-a317-4950-8dc7-3283d59de850 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 31 19:52:18.380861 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 7/13] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:52:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:52:18.809508 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-bb99171b-10dd-4c2c-8288-d101c7670ccf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "ram": 2048, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:18.828549 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-bb99171b-10dd-4c2c-8288-d101c7670ccf admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441879 Jul 31 19:52:18.829085 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 7/14] 10.222.0.48 () {64 vars in 1282 bytes} [Sun Jul 31 19:52:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 19:52:18.847406 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-9e3159ef-b551-455b-a340-00050b70eefc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:18.884245 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-9e3159ef-b551-455b-a340-00050b70eefc admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045881 Jul 31 19:52:18.885941 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 8/15] 10.222.0.48 () {64 vars in 1335 bytes} [Sun Jul 31 19:52:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 19:52:21.082692 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-bb99171b-10dd-4c2c-8288-d101c7670ccf admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:21.083877 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-bb99171b-10dd-4c2c-8288-d101c7670ccf admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Jul 31 19:52:21.084542 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 8/16] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:52:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:52:21.617429 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-67eb0090-6ea6-49bd-91f0-a241f2a06c7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "id": "d4", "disk": 20, "name": "ds4G", "rxtx_factor": 1.0}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:21.638993 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-67eb0090-6ea6-49bd-91f0-a241f2a06c7c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.548518 Jul 31 19:52:21.639540 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 9/17] 10.222.0.48 () {64 vars in 1282 bytes} [Sun Jul 31 19:52:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 19:52:21.651764 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-5f5e90fd-83e4-47ec-a308-e3b31fa54af9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:21.679755 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-5f5e90fd-83e4-47ec-a308-e3b31fa54af9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031537 Jul 31 19:52:21.680688 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 9/18] 10.222.0.48 () {64 vars in 1335 bytes} [Sun Jul 31 19:52:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:52:23.901333 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-67eb0090-6ea6-49bd-91f0-a241f2a06c7c admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:23.902772 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-67eb0090-6ea6-49bd-91f0-a241f2a06c7c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002234 Jul 31 19:52:23.903264 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 10/19] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:52:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:52:24.373035 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-359cf0dd-de90-4bd9-85eb-abd321b4dbeb admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:24.401643 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-359cf0dd-de90-4bd9-85eb-abd321b4dbeb admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.490325 Jul 31 19:52:24.402186 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 10/20] 10.222.0.48 () {60 vars in 1291 bytes} [Sun Jul 31 19:52:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:52:26.979228 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-67eb0090-6ea6-49bd-91f0-a241f2a06c7c admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:26.980233 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-67eb0090-6ea6-49bd-91f0-a241f2a06c7c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001696 Jul 31 19:52:26.980652 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 11/21] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:52:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:52:27.421568 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-4e138369-7eb9-424c-bf59-58fcba3700b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "swap": 0, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:27.444437 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-4e138369-7eb9-424c-bf59-58fcba3700b7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.457201 Jul 31 19:52:27.445216 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 11/22] 10.222.0.48 () {64 vars in 1282 bytes} [Sun Jul 31 19:52:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 19:52:27.459016 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-1b26f5ed-9703-42cf-b5e8-8bdbca59091c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:27.487722 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-1b26f5ed-9703-42cf-b5e8-8bdbca59091c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032634 Jul 31 19:52:27.488575 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 12/23] 10.222.0.48 () {64 vars in 1332 bytes} [Sun Jul 31 19:52:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:52:29.705813 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-4e138369-7eb9-424c-bf59-58fcba3700b7 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:29.706872 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-4e138369-7eb9-424c-bf59-58fcba3700b7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jul 31 19:52:29.707264 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:52:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:52:30.127617 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-6f5ea5e8-667b-4389-afa4-a7f1b3b3eefa admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 1, "id": "2"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:30.148011 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-6f5ea5e8-667b-4389-afa4-a7f1b3b3eefa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.434451 Jul 31 19:52:30.148547 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 13/25] 10.222.0.48 () {64 vars in 1282 bytes} [Sun Jul 31 19:52:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 19:52:30.160852 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-0d2643ca-7efb-432a-ae27-48056d564dd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:30.184447 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-0d2643ca-7efb-432a-ae27-48056d564dd2 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027325 Jul 31 19:52:30.185028 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 13/26] 10.222.0.48 () {64 vars in 1332 bytes} [Sun Jul 31 19:52:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:52:32.369805 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-6f5ea5e8-667b-4389-afa4-a7f1b3b3eefa admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:32.370809 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-6f5ea5e8-667b-4389-afa4-a7f1b3b3eefa admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001848 Jul 31 19:52:32.371208 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 14/27] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:52:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 19:52:32.775570 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-9391f173-fa39-41ce-8b3c-ca6ecbbfcb6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:32.798082 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-9391f173-fa39-41ce-8b3c-ca6ecbbfcb6f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.420907 Jul 31 19:52:32.798934 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 14/28] 10.222.0.48 () {64 vars in 1282 bytes} [Sun Jul 31 19:52:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 19:52:32.814897 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-c74088aa-7c5e-4399-8bd3-bed39092589f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:32.841335 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-c74088aa-7c5e-4399-8bd3-bed39092589f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034298 Jul 31 19:52:32.842003 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 15/29] 10.222.0.48 () {64 vars in 1332 bytes} [Sun Jul 31 19:52:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:52:35.073177 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-9391f173-fa39-41ce-8b3c-ca6ecbbfcb6f admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:35.074261 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-9391f173-fa39-41ce-8b3c-ca6ecbbfcb6f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jul 31 19:52:35.074669 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 15/30] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:52:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:52:35.550477 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-eb3d0863-04ce-4b26-812d-1c6be419cdc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:35.572776 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-eb3d0863-04ce-4b26-812d-1c6be419cdc0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.492084 Jul 31 19:52:35.573363 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 16/31] 10.222.0.48 () {64 vars in 1282 bytes} [Sun Jul 31 19:52:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 19:52:35.585636 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-9b634431-929c-4bfc-904a-bb52d31682b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:35.611057 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-9b634431-929c-4bfc-904a-bb52d31682b7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029368 Jul 31 19:52:35.611620 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 16/32] 10.222.0.48 () {64 vars in 1332 bytes} [Sun Jul 31 19:52:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:52:37.819191 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-eb3d0863-04ce-4b26-812d-1c6be419cdc0 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:37.820216 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-eb3d0863-04ce-4b26-812d-1c6be419cdc0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 31 19:52:37.820632 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 17/33] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:52:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 19:52:38.268965 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-6ada50f5-b28e-487f-bd91-b0208170b1fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "swap": 0, "id": "5", "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:38.291009 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-6ada50f5-b28e-487f-bd91-b0208170b1fa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.464332 Jul 31 19:52:38.293715 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 17/34] 10.222.0.48 () {64 vars in 1282 bytes} [Sun Jul 31 19:52:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 19:52:38.305846 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-e98eabd0-d1a8-4fd2-8465-c9f00f818808 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:52:38.314027 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:52:38.333251 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-e98eabd0-d1a8-4fd2-8465-c9f00f818808 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031121 Jul 31 19:52:38.333845 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 18/35] 10.222.0.48 () {64 vars in 1332 bytes} [Sun Jul 31 19:52:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:52:57.588620 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-6ada50f5-b28e-487f-bd91-b0208170b1fa admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:57.589673 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-6ada50f5-b28e-487f-bd91-b0208170b1fa admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Jul 31 19:52:57.590065 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 18/36] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:52:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:52:58.005074 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-ae4d106f-6afe-48ce-8984-10d3e659c8df admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:58.023116 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-ae4d106f-6afe-48ce-8984-10d3e659c8df admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.426417 Jul 31 19:52:58.023584 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 19/37] 10.222.0.48 () {60 vars in 1291 bytes} [Sun Jul 31 19:52:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:52:59.102900 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-6ada50f5-b28e-487f-bd91-b0208170b1fa admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:59.104504 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-6ada50f5-b28e-487f-bd91-b0208170b1fa admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002243 Jul 31 19:52:59.105123 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 19/38] 10.222.0.48 () {56 vars in 1074 bytes} [Sun Jul 31 19:52:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:52:59.647401 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-147140cb-f661-463c-9f5d-c58d3f18223f admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:59.653020 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.wsgi [None req-147140cb-f661-463c-9f5d-c58d3f18223f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-147140cb-f661-463c-9f5d-c58d3f18223f admin admin] Request method failure captured: Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Accept: application/json Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Accept-Encoding: gzip, deflate Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Connection: keep-alive Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Content-Length: 0 Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Host: 10.222.0.48 Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Openstack-Api-Version: compute 2.90 Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Openstack-System-Scope: None Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: User-Agent: python-novaclient Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Auth-Token: gAAAAABi5t2a1_MJN1OkVKP-BvIAE5qOtIn1YZoG8DDIHx98qAnI4USjljh-J_KcwlnRianig7tENDopjWFCmBtc6TLc4iltcp32sM8QK7r8VPo6Wfy_bBY5vZs9SWvNT1JNcYPpwGPCEzWUEEM1sKcukuq6m3NQB8P76hGBtfjm-ZN6gNtH38c Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Domain-Id: None Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Domain-Name: None Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Identity-Status: Confirmed Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Is-Admin-Project: True Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Project-Domain-Id: default Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Project-Domain-Name: Default Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Project-Id: 824b8dfe9c554dc59a5e616eae69d90e Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Project-Name: admin Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Role: reader,admin,member Jul 31 19:52:59.656346 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Roles: reader,admin,member Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/824b8dfe9c554dc59a5e616eae69d90e"}]}] Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Tenant: admin Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Tenant-Id: 824b8dfe9c554dc59a5e616eae69d90e Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Tenant-Name: admin Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User: admin Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User-Domain-Id: default Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User-Domain-Name: Default Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User-Id: b923b4c6032e4da991f207a6573c0ceb Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User-Name: admin Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: method: > Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: exception: Flavor 42 could not be found. Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: action_args: {'id': '42'} Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 19:52:59.658075 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:52:59.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:52:59.660634 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-147140cb-f661-463c-9f5d-c58d3f18223f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 19:52:59.662003 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-147140cb-f661-463c-9f5d-c58d3f18223f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.411564 Jul 31 19:52:59.662003 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 20/39] 10.222.0.48 () {60 vars in 1190 bytes} [Sun Jul 31 19:52:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 19:52:59.668061 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-29c9cad2-0862-4bcd-aa1c-ba54fc888f13 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:59.672355 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:52:59.693027 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-29c9cad2-0862-4bcd-aa1c-ba54fc888f13 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028610 Jul 31 19:52:59.693597 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 20/40] 10.222.0.48 () {60 vars in 1210 bytes} [Sun Jul 31 19:52:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:52:59.708779 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-df86d9b7-6bce-4773-894d-6e5178aa8a92 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:59.732992 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-df86d9b7-6bce-4773-894d-6e5178aa8a92 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030147 Jul 31 19:52:59.733534 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 21/41] 10.222.0.48 () {60 vars in 1210 bytes} [Sun Jul 31 19:52:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:52:59.743099 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-55e3c084-b44d-434f-b1ac-9a48cf659279 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:52:59.750472 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.wsgi [None req-55e3c084-b44d-434f-b1ac-9a48cf659279 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-55e3c084-b44d-434f-b1ac-9a48cf659279 admin admin] Request method failure captured: Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Accept: application/json Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Accept-Encoding: gzip, deflate Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Connection: keep-alive Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Content-Length: 0 Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Host: 10.222.0.48 Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Openstack-Api-Version: compute 2.90 Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Openstack-System-Scope: None Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: User-Agent: python-novaclient Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Auth-Token: gAAAAABi5t2a1_MJN1OkVKP-BvIAE5qOtIn1YZoG8DDIHx98qAnI4USjljh-J_KcwlnRianig7tENDopjWFCmBtc6TLc4iltcp32sM8QK7r8VPo6Wfy_bBY5vZs9SWvNT1JNcYPpwGPCEzWUEEM1sKcukuq6m3NQB8P76hGBtfjm-ZN6gNtH38c Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Domain-Id: None Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Domain-Name: None Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Identity-Status: Confirmed Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Is-Admin-Project: True Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Project-Domain-Id: default Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Project-Domain-Name: Default Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Project-Id: 824b8dfe9c554dc59a5e616eae69d90e Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Project-Name: admin Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Role: reader,admin,member Jul 31 19:52:59.753769 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Roles: reader,admin,member Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/824b8dfe9c554dc59a5e616eae69d90e"}]}] Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Tenant: admin Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Tenant-Id: 824b8dfe9c554dc59a5e616eae69d90e Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Tenant-Name: admin Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User: admin Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User-Domain-Id: default Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User-Domain-Name: Default Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User-Id: b923b4c6032e4da991f207a6573c0ceb Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User-Name: admin Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: method: > Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: exception: Flavor 42 could not be found. Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: action_args: {'id': '42'} Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 19:52:59.755232 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:52:59.756192 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:52:59.757430 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-55e3c084-b44d-434f-b1ac-9a48cf659279 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 19:52:59.758694 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-55e3c084-b44d-434f-b1ac-9a48cf659279 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015842 Jul 31 19:52:59.758694 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 21/42] 10.222.0.48 () {60 vars in 1190 bytes} [Sun Jul 31 19:52:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 19:53:00.731434 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-df86d9b7-6bce-4773-894d-6e5178aa8a92 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:00.732449 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-df86d9b7-6bce-4773-894d-6e5178aa8a92 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 31 19:53:00.732843 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 22/43] 10.222.0.48 () {56 vars in 1074 bytes} [Sun Jul 31 19:53:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:53:01.297841 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-63b79be5-60a9-4921-a16b-69c3a67b73d7 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:01.303440 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.wsgi [None req-63b79be5-60a9-4921-a16b-69c3a67b73d7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-63b79be5-60a9-4921-a16b-69c3a67b73d7 admin admin] Request method failure captured: Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Accept: application/json Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Accept-Encoding: gzip, deflate Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Connection: keep-alive Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Content-Length: 0 Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Host: 10.222.0.48 Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Openstack-Api-Version: compute 2.90 Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Openstack-System-Scope: None Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: User-Agent: python-novaclient Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Auth-Token: gAAAAABi5t2crTn-PGKXm7el0FCPQMpiRRC5izKNq5tev9gz1IZr-p66nGSY9PB66LDSvSuifrVzzi4zjfdK_g3VcHeUkIkpY3D07YXJgFgVYElVANfSHr-LI6mq_tgzZBKBh-yKtB6dUlYp5E8C-Svuewx8596MwFeuLyRrBSHP8eJjtGL2cQA Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Domain-Id: None Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Domain-Name: None Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Identity-Status: Confirmed Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Is-Admin-Project: True Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Project-Domain-Id: default Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Project-Domain-Name: Default Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Project-Id: 824b8dfe9c554dc59a5e616eae69d90e Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Project-Name: admin Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Role: reader,admin,member Jul 31 19:53:01.305029 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Roles: reader,admin,member Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/824b8dfe9c554dc59a5e616eae69d90e"}]}] Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Tenant: admin Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Tenant-Id: 824b8dfe9c554dc59a5e616eae69d90e Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Tenant-Name: admin Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User: admin Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User-Domain-Id: default Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User-Domain-Name: Default Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User-Id: b923b4c6032e4da991f207a6573c0ceb Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User-Name: admin Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: method: > Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: exception: Flavor 84 could not be found. Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: action_args: {'id': '84'} Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 19:53:01.306631 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:53:01.307528 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:53:01.308808 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-63b79be5-60a9-4921-a16b-69c3a67b73d7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 19:53:01.310086 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-63b79be5-60a9-4921-a16b-69c3a67b73d7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.435855 Jul 31 19:53:01.310086 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 22/44] 10.222.0.48 () {60 vars in 1190 bytes} [Sun Jul 31 19:53:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 19:53:01.318970 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-fc4f3bdf-8d30-44da-8119-5d0ab50bbc57 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:01.339479 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-fc4f3bdf-8d30-44da-8119-5d0ab50bbc57 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026489 Jul 31 19:53:01.340006 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 23/45] 10.222.0.48 () {60 vars in 1210 bytes} [Sun Jul 31 19:53:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:53:01.349317 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-71e9f0dd-20bd-474a-bdbd-03733438d99b admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:01.364215 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-71e9f0dd-20bd-474a-bdbd-03733438d99b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018411 Jul 31 19:53:01.364724 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 23/46] 10.222.0.48 () {60 vars in 1210 bytes} [Sun Jul 31 19:53:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 19:53:01.374430 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a9fcf7fa-f85c-44b9-827b-96d6f5c09699 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:01.379778 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.wsgi [None req-a9fcf7fa-f85c-44b9-827b-96d6f5c09699 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a9fcf7fa-f85c-44b9-827b-96d6f5c09699 admin admin] Request method failure captured: Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Accept: application/json Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Accept-Encoding: gzip, deflate Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Connection: keep-alive Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Content-Length: 0 Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Host: 10.222.0.48 Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Openstack-Api-Version: compute 2.90 Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Openstack-System-Scope: None Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: User-Agent: python-novaclient Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Auth-Token: gAAAAABi5t2crTn-PGKXm7el0FCPQMpiRRC5izKNq5tev9gz1IZr-p66nGSY9PB66LDSvSuifrVzzi4zjfdK_g3VcHeUkIkpY3D07YXJgFgVYElVANfSHr-LI6mq_tgzZBKBh-yKtB6dUlYp5E8C-Svuewx8596MwFeuLyRrBSHP8eJjtGL2cQA Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Domain-Id: None Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Domain-Name: None Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Identity-Status: Confirmed Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Is-Admin-Project: True Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Project-Domain-Id: default Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Project-Domain-Name: Default Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Project-Id: 824b8dfe9c554dc59a5e616eae69d90e Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Project-Name: admin Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Role: reader,admin,member Jul 31 19:53:01.381306 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Roles: reader,admin,member Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/824b8dfe9c554dc59a5e616eae69d90e"}]}] Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Tenant: admin Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Tenant-Id: 824b8dfe9c554dc59a5e616eae69d90e Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Tenant-Name: admin Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User: admin Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User-Domain-Id: default Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User-Domain-Name: Default Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User-Id: b923b4c6032e4da991f207a6573c0ceb Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User-Name: admin Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: method: > Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: exception: Flavor 84 could not be found. Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: action_args: {'id': '84'} Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 19:53:01.382751 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:53:01.383693 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:53:01.385019 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a9fcf7fa-f85c-44b9-827b-96d6f5c09699 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 19:53:01.386320 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-a9fcf7fa-f85c-44b9-827b-96d6f5c09699 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011803 Jul 31 19:53:01.386320 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 24/47] 10.222.0.48 () {60 vars in 1190 bytes} [Sun Jul 31 19:53:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 19:53:02.358699 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-71e9f0dd-20bd-474a-bdbd-03733438d99b admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:02.359702 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-71e9f0dd-20bd-474a-bdbd-03733438d99b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 31 19:53:02.360094 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 24/48] 10.222.0.48 () {56 vars in 1074 bytes} [Sun Jul 31 19:53:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 19:53:02.923133 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-3e6e8b50-b96c-4618-b299-3db2cba45dfa admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:02.929294 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.wsgi [None req-3e6e8b50-b96c-4618-b299-3db2cba45dfa admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-3e6e8b50-b96c-4618-b299-3db2cba45dfa admin admin] Request method failure captured: Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Accept: application/json Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Accept-Encoding: gzip, deflate Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Connection: keep-alive Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Content-Length: 0 Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Host: 10.222.0.48 Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Openstack-Api-Version: compute 2.90 Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Openstack-System-Scope: None Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: User-Agent: python-novaclient Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Auth-Token: gAAAAABi5t2eD3h7tCN8Zn4g5WRThxMb-2m74bJO66z4lS09FsmDKcbFSIZ5KzRaSfA49M0fZixSroXlIJMk9mBm68MGKptpyjM8CnZCRK_OqFCpiGVi7P5jSMkOzO4KiYY4Jyd-mrIa1HG1BlhG33Xyn5RXjhwjXRV_tUecSrrr3_-LcS17qnE Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Domain-Id: None Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Domain-Name: None Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Identity-Status: Confirmed Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Is-Admin-Project: True Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Project-Domain-Id: default Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Project-Domain-Name: Default Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Project-Id: 824b8dfe9c554dc59a5e616eae69d90e Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Project-Name: admin Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Role: reader,admin,member Jul 31 19:53:02.930793 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Roles: reader,admin,member Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/824b8dfe9c554dc59a5e616eae69d90e"}]}] Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Tenant: admin Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Tenant-Id: 824b8dfe9c554dc59a5e616eae69d90e Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-Tenant-Name: admin Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User: admin Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User-Domain-Id: default Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User-Domain-Name: Default Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User-Id: b923b4c6032e4da991f207a6573c0ceb Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: X-User-Name: admin Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: method: > Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: exception: Flavor 451 could not be found. Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: action_args: {'id': '451'} Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 19:53:02.932241 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:53:02.933295 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 31 19:53:02.934408 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-3e6e8b50-b96c-4618-b299-3db2cba45dfa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 19:53:02.935488 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-3e6e8b50-b96c-4618-b299-3db2cba45dfa admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.436019 Jul 31 19:53:02.935488 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 25/49] 10.222.0.48 () {60 vars in 1193 bytes} [Sun Jul 31 19:53:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 19:53:02.941847 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-fd0d640a-20f7-409c-8370-6405590726ac admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:02.956740 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-fd0d640a-20f7-409c-8370-6405590726ac admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018465 Jul 31 19:53:02.957265 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 25/50] 10.222.0.48 () {60 vars in 1210 bytes} [Sun Jul 31 19:53:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:53:02.969020 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:02.992008 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028263 Jul 31 19:53:02.992525 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 26/51] 10.222.0.48 () {60 vars in 1210 bytes} [Sun Jul 31 19:53:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:53:03.002166 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-74e135f9-4fe7-4b84-8557-41adfaf1dfd9 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:03.007679 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.wsgi [None req-74e135f9-4fe7-4b84-8557-41adfaf1dfd9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-74e135f9-4fe7-4b84-8557-41adfaf1dfd9 admin admin] Request method failure captured: Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Accept: application/json Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Accept-Encoding: gzip, deflate Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Connection: keep-alive Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Content-Length: 0 Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Host: 10.222.0.48 Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Openstack-Api-Version: compute 2.90 Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Openstack-System-Scope: None Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: User-Agent: python-novaclient Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Auth-Token: gAAAAABi5t2eD3h7tCN8Zn4g5WRThxMb-2m74bJO66z4lS09FsmDKcbFSIZ5KzRaSfA49M0fZixSroXlIJMk9mBm68MGKptpyjM8CnZCRK_OqFCpiGVi7P5jSMkOzO4KiYY4Jyd-mrIa1HG1BlhG33Xyn5RXjhwjXRV_tUecSrrr3_-LcS17qnE Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Domain-Id: None Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Domain-Name: None Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Identity-Status: Confirmed Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Is-Admin-Project: True Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Project-Domain-Id: default Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Project-Domain-Name: Default Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Project-Id: 824b8dfe9c554dc59a5e616eae69d90e Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Project-Name: admin Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Role: reader,admin,member Jul 31 19:53:03.009134 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Roles: reader,admin,member Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_824b8dfe9c554dc59a5e616eae69d90e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/824b8dfe9c554dc59a5e616eae69d90e"}]}] Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Tenant: admin Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Tenant-Id: 824b8dfe9c554dc59a5e616eae69d90e Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-Tenant-Name: admin Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User: admin Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User-Domain-Id: default Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User-Domain-Name: Default Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User-Id: b923b4c6032e4da991f207a6573c0ceb Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: X-User-Name: admin Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: method: > Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: exception: Flavor 451 could not be found. Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: action_args: {'id': '451'} Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 19:53:03.010816 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:53:03.011707 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 31 19:53:03.012761 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-74e135f9-4fe7-4b84-8557-41adfaf1dfd9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 19:53:03.013815 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-74e135f9-4fe7-4b84-8557-41adfaf1dfd9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011866 Jul 31 19:53:03.013815 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 26/52] 10.222.0.48 () {60 vars in 1193 bytes} [Sun Jul 31 19:53:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 19:53:03.990884 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:03.992238 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 Jul 31 19:53:03.992773 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 27/53] 10.222.0.48 () {56 vars in 1074 bytes} [Sun Jul 31 19:53:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:53:04.560980 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-d9f53afc-d0b1-4ebc-a527-88f49ae71af9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:53:04.582475 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-d9f53afc-d0b1-4ebc-a527-88f49ae71af9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.447478 Jul 31 19:53:04.583049 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 27/54] 10.222.0.48 () {64 vars in 1235 bytes} [Sun Jul 31 19:53:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 19:53:05.566621 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:05.567647 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 31 19:53:05.568016 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 28/55] 10.222.0.48 () {56 vars in 1074 bytes} [Sun Jul 31 19:53:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:53:06.140420 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-b81dac8d-1f97-4af9-a664-3d34f76b9f76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:53:06.163454 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-b81dac8d-1f97-4af9-a664-3d34f76b9f76 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.457762 Jul 31 19:53:06.164006 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 28/56] 10.222.0.48 () {64 vars in 1235 bytes} [Sun Jul 31 19:53:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 19:53:07.133045 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:07.134044 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 Jul 31 19:53:07.134441 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 29/57] 10.222.0.48 () {56 vars in 1074 bytes} [Sun Jul 31 19:53:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:53:07.697095 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-3e088c44-55bf-4487-b328-8ec678a8a118 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:53:07.718798 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-3e088c44-55bf-4487-b328-8ec678a8a118 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.448143 Jul 31 19:53:07.719335 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 29/58] 10.222.0.48 () {64 vars in 1235 bytes} [Sun Jul 31 19:53:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 19:53:08.712595 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:08.713677 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jul 31 19:53:08.714078 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 30/59] 10.222.0.48 () {56 vars in 1074 bytes} [Sun Jul 31 19:53:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:53:09.295141 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-6e94effe-a907-40ff-b459-7800b1ce9c07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:53:09.317838 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-6e94effe-a907-40ff-b459-7800b1ce9c07 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.462709 Jul 31 19:53:09.318361 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 30/60] 10.222.0.48 () {64 vars in 1235 bytes} [Sun Jul 31 19:53:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 19:53:10.301379 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:10.302410 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 31 19:53:10.302815 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 31/61] 10.222.0.48 () {56 vars in 1074 bytes} [Sun Jul 31 19:53:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:53:10.861773 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-b4e46378-4b0b-4f58-9399-829a19e61a7f admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:53:10.882401 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-b4e46378-4b0b-4f58-9399-829a19e61a7f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.443805 Jul 31 19:53:10.882930 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 31/62] 10.222.0.48 () {60 vars in 1202 bytes} [Sun Jul 31 19:53:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:54:02.496871 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:54:02.498204 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-12f23f4c-21b2-4763-9b1c-98dcf6bec4c1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 Jul 31 19:54:02.498565 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 32/63] 10.222.0.48 () {54 vars in 930 bytes} [Sun Jul 31 19:54:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:54:02.509030 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:54:02.925646 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-4c35b8c8-097e-4508-aed5-b84be95bf4b3 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:54:02.945736 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-4c35b8c8-097e-4508-aed5-b84be95bf4b3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.441216 Jul 31 19:54:02.946271 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 32/64] 10.222.0.48 () {60 vars in 1291 bytes} [Sun Jul 31 19:54:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:54:02.967235 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:54:02.971184 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-d7759141-e98c-41e4-ac0d-fbb906922674 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:54:02.979456 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-d7759141-e98c-41e4-ac0d-fbb906922674 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013652 Jul 31 19:54:02.979985 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 33/65] 10.222.0.48 () {60 vars in 1282 bytes} [Sun Jul 31 19:54:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 19:54:02.991785 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-e0d4aca1-d987-4d40-8c9b-9dfd311b5335 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:54:03.000075 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-e0d4aca1-d987-4d40-8c9b-9dfd311b5335 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011914 Jul 31 19:54:03.000587 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 33/66] 10.222.0.48 () {60 vars in 1285 bytes} [Sun Jul 31 19:54:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:54:03.011463 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-85effd01-d489-4b97-b293-2df774cbbb8f admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:54:03.019614 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-85effd01-d489-4b97-b293-2df774cbbb8f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011586 Jul 31 19:54:03.020129 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 34/67] 10.222.0.48 () {60 vars in 1285 bytes} [Sun Jul 31 19:54:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:54:03.031208 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-87b3ef1d-84df-4797-9d24-91f549493be2 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:54:03.039206 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-87b3ef1d-84df-4797-9d24-91f549493be2 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011492 Jul 31 19:54:03.039739 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 34/68] 10.222.0.48 () {60 vars in 1282 bytes} [Sun Jul 31 19:54:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:57:28.004437 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-85effd01-d489-4b97-b293-2df774cbbb8f admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:57:28.005556 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-85effd01-d489-4b97-b293-2df774cbbb8f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 31 19:57:28.005910 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 35/69] 10.222.0.48 () {56 vars in 1074 bytes} [Sun Jul 31 19:57:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:57:28.149487 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_api:SELECT=6 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:57:28.316988 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-212fcc26-5541-42c8-9f38-f2dd040ed0a7 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:57:28.319347 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 19:57:28.319347 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: warnings.warn(msg) Jul 31 19:57:28.320548 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-212fcc26-5541-42c8-9f38-f2dd040ed0a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:57:28.320986 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-212fcc26-5541-42c8-9f38-f2dd040ed0a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:57:28.321800 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-212fcc26-5541-42c8-9f38-f2dd040ed0a7 admin admin] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:57:28.322222 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-212fcc26-5541-42c8-9f38-f2dd040ed0a7 admin admin] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:57:28.355295 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-212fcc26-5541-42c8-9f38-f2dd040ed0a7 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.209314 Jul 31 19:57:28.355848 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 35/70] 10.222.0.48 () {60 vars in 1193 bytes} [Sun Jul 31 19:57:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 19:57:29.177312 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-85effd01-d489-4b97-b293-2df774cbbb8f admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:57:29.178316 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-85effd01-d489-4b97-b293-2df774cbbb8f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 31 19:57:29.178725 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 36/71] 10.222.0.48 () {56 vars in 1074 bytes} [Sun Jul 31 19:57:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:57:29.380222 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-4ffc5c59-cd3e-4a93-96b6-d6715a501a58 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:57:29.382654 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 19:57:29.382654 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: warnings.warn(msg) Jul 31 19:57:29.383828 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-4ffc5c59-cd3e-4a93-96b6-d6715a501a58 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:57:29.384264 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-4ffc5c59-cd3e-4a93-96b6-d6715a501a58 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:57:29.385030 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-4ffc5c59-cd3e-4a93-96b6-d6715a501a58 admin admin] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:57:29.385469 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-4ffc5c59-cd3e-4a93-96b6-d6715a501a58 admin admin] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:57:29.405481 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-4ffc5c59-cd3e-4a93-96b6-d6715a501a58 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085392 Jul 31 19:57:29.406043 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 36/72] 10.222.0.48 () {60 vars in 1193 bytes} [Sun Jul 31 19:57:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 19:57:40.677058 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-85effd01-d489-4b97-b293-2df774cbbb8f admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:57:40.678385 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-85effd01-d489-4b97-b293-2df774cbbb8f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Jul 31 19:57:40.678950 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 37/73] 10.222.0.48 () {56 vars in 1074 bytes} [Sun Jul 31 19:57:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:57:40.827101 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_cell0:SELECT=4 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:57:40.827995 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_cell1:SELECT=4 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:57:40.828800 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_api:SELECT=8 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:57:40.883429 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-a4208a23-41e6-49ad-a5dc-28aa842303ad admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:57:40.887002 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 19:57:40.887002 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: warnings.warn(msg) Jul 31 19:57:40.888821 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-a4208a23-41e6-49ad-a5dc-28aa842303ad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:57:40.889714 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-a4208a23-41e6-49ad-a5dc-28aa842303ad admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:57:40.890924 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-a4208a23-41e6-49ad-a5dc-28aa842303ad admin admin] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:57:40.891551 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-a4208a23-41e6-49ad-a5dc-28aa842303ad admin admin] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:57:40.921228 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-a4208a23-41e6-49ad-a5dc-28aa842303ad admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.101588 Jul 31 19:57:40.921752 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 37/74] 10.222.0.48 () {60 vars in 1193 bytes} [Sun Jul 31 19:57:40 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:57:41.750773 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-85effd01-d489-4b97-b293-2df774cbbb8f admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:57:41.751790 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-85effd01-d489-4b97-b293-2df774cbbb8f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 31 19:57:41.752190 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 38/75] 10.222.0.48 () {56 vars in 1074 bytes} [Sun Jul 31 19:57:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:57:41.966085 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-b922890b-426e-4bfb-8bca-988af7897139 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:57:41.968508 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 19:57:41.968508 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: warnings.warn(msg) Jul 31 19:57:41.969726 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-b922890b-426e-4bfb-8bca-988af7897139 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:57:41.970164 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-b922890b-426e-4bfb-8bca-988af7897139 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:57:41.970914 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-b922890b-426e-4bfb-8bca-988af7897139 admin admin] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:57:41.971334 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-b922890b-426e-4bfb-8bca-988af7897139 admin admin] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:57:41.993065 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-b922890b-426e-4bfb-8bca-988af7897139 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.101613 Jul 31 19:57:41.994005 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 38/76] 10.222.0.48 () {60 vars in 1193 bytes} [Sun Jul 31 19:57:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:58:36.371561 dv-cinder-849846-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 31 19:58:36.372131 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: Sun Jul 31 19:58:36 2022 - graceful shutdown triggered... Jul 31 19:58:36.372561 dv-cinder-849846-6-iscsi devstack@n-api.service[103252]: Gracefully killing worker 1 (pid: 103252)... Jul 31 19:58:36.373061 dv-cinder-849846-6-iscsi devstack@n-api.service[103253]: Gracefully killing worker 2 (pid: 103253)... Jul 31 19:58:37.373333 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: worker 1 buried after 1 seconds Jul 31 19:58:37.373333 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: worker 2 buried after 1 seconds Jul 31 19:58:37.373333 dv-cinder-849846-6-iscsi devstack@n-api.service[103251]: goodbye to uWSGI. Jul 31 19:58:37.375838 dv-cinder-849846-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 31 19:58:37.376694 dv-cinder-849846-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 31 19:58:37.381052 dv-cinder-849846-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 31 19:58:37.394303 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 31 19:58:37.396903 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 31 19:58:37 2022] *** Jul 31 19:58:37.397057 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 31 19:58:37.397448 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 31 19:58:37.397557 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: nodename: dv-cinder-849846-6-iscsi Jul 31 19:58:37.397665 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: machine: x86_64 Jul 31 19:58:37.397772 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: clock source: unix Jul 31 19:58:37.397884 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: pcre jit disabled Jul 31 19:58:37.398004 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: detected number of CPU cores: 4 Jul 31 19:58:37.398104 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: current working directory: / Jul 31 19:58:37.398200 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: detected binary path: /usr/bin/uwsgi-core Jul 31 19:58:37.398424 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: your processes number limit is 47680 Jul 31 19:58:37.398543 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: your memory page size is 4096 bytes Jul 31 19:58:37.398652 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: detected max file descriptor number: 2048 Jul 31 19:58:37.398760 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: lock engine: pthread robust mutexes Jul 31 19:58:37.399042 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: thunder lock: enabled Jul 31 19:58:37.399382 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 31 19:58:37.399535 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 31 19:58:37.439437 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: Python main interpreter initialized at 0x55683ea059c0 Jul 31 19:58:37.439437 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: python threads support enabled Jul 31 19:58:37.439437 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: your server socket listen backlog is limited to 100 connections Jul 31 19:58:37.439437 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: your mercy for graceful operations on workers is 90 seconds Jul 31 19:58:37.439927 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: mapped 403077 bytes (393 KB) for 2 cores Jul 31 19:58:37.439927 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: *** Operational MODE: preforking *** Jul 31 19:58:37.440137 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: *** uWSGI is running in multiple interpreter mode *** Jul 31 19:58:37.440137 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: spawned uWSGI master process (pid: 117905) Jul 31 19:58:37.440333 dv-cinder-849846-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 31 19:58:37.441220 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: spawned uWSGI worker 1 (pid: 117919, cores: 1) Jul 31 19:58:37.441520 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: spawned uWSGI worker 2 (pid: 117920, cores: 1) Jul 31 19:58:37.441748 dv-cinder-849846-6-iscsi devstack@n-api.service[117905]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 31 19:58:38.106080 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 19:58:38.110471 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 19:58:39.272961 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 19:58:39.272961 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: from cryptography.utils import int_from_bytes Jul 31 19:58:39.274211 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 19:58:39.274211 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: from cryptography.utils import int_from_bytes Jul 31 19:58:39.313014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 19:58:39.313014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: from cryptography.utils import int_from_bytes Jul 31 19:58:39.313608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 19:58:39.313608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: from cryptography.utils import int_from_bytes Jul 31 19:58:41.669071 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 19:58:41.669745 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 19:58:41.670079 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 19:58:41.670271 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 19:58:41.670493 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 19:58:41.670907 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.671232 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.671516 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.671869 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.672227 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.672537 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.672854 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.673202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.673516 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.673744 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.674084 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.674399 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-6-iscsi {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.674686 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.675198 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.675474 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.675796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.676104 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.676447 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.676763 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.677273 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.678041 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.678347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.678733 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.679093 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.679413 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.679723 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.680046 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.680352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.680663 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.680957 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.681429 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-6-iscsi {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.681740 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.682020 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.682349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.682772 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.683098 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.683360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.683696 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.684011 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.684324 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.684641 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.684972 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.685288 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.685622 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.685907 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.686212 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.686542 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.686848 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.687175 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.687443 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.687750 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.688058 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.688378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.688708 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.689028 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.689313 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.689546 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.689869 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.690185 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.690488 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.690790 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.691074 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.691373 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.691677 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.691976 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.692276 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.692580 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.692892 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.693233 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.693551 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.693851 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.694161 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.694569 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.694818 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.695120 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.695463 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.695771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.696084 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.696387 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.696778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.697068 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.697395 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.697695 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.698008 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.698358 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.698665 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.698890 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.699194 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.699492 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.699804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.700105 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.700406 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.700705 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.700998 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.701321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.701622 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.701923 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.702222 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.702532 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.702828 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.703163 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.703465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.703762 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.704078 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.704392 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.704694 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.704993 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.705323 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.705639 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.705952 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.706247 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.706544 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.706877 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.707218 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.707514 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.707828 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.708129 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.708563 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.708744 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.709114 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.709425 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.709651 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.709951 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.710249 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.710542 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.710838 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.711134 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.711431 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.711722 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.712016 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.712309 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.712691 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.712954 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.713259 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.713552 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.713846 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.714157 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.714491 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.714820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.715158 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.715470 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.715798 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.716122 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.716444 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.716598 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 19:58:41.717117 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.717336 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 19:58:41.717490 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.717632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 19:58:41.717783 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.717783 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.718060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 19:58:41.718060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 19:58:41.718336 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.718336 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.718657 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.718958 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.719133 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.719414 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.719589 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.719747 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.719967 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.720116 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.720265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.720407 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.720548 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.720702 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.720851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.720992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.721144 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.721316 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.721477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.721638 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.721779 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.721939 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.722132 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.722284 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.722561 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-6-iscsi {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.722720 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.722967 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.723208 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.723362 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.723506 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.723660 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.723812 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.723961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.724102 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.724250 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.724401 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.724543 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.724808 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.724968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.725120 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.725120 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.725467 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.725467 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.725792 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.726016 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.726162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.726309 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.726476 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.726476 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.726830 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.726980 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.727128 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.727278 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.727427 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.727584 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.727744 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.727886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.728033 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.728033 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.728321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.728462 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.728609 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.728609 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.728890 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-6-iscsi {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.729136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.729316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.729618 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.729767 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.729935 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.730164 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.730319 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.730460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.730607 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.730755 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.730912 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.731060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.731208 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.731348 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.731490 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.731640 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.731791 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.731953 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.732105 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.732300 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.732442 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.732682 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.732844 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.733014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.733365 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.733523 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.733667 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.733808 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.733963 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.734117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.734264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.734405 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.734554 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.734704 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.734846 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.734987 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.735127 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.735274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.735415 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.735566 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.735708 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.735848 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.736018 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.736235 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.736381 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.736535 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.736695 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.736917 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.737068 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.737230 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.737396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.737806 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.737955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.738095 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.738247 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.738388 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.738545 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.738694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.738836 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.738975 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.739139 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.739382 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.739556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.739854 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.740006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.740182 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.740413 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.740569 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.740711 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.740851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.740990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.741137 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.741137 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.741451 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.741592 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.741741 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.741881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.742038 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.742182 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.742396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.742547 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.742712 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.742712 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.743070 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.743212 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.743888 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.744034 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.744174 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.744314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.744463 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.744619 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.744785 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.745012 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.745177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.745325 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.745569 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.745737 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.745737 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.745737 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.746154 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.746384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.746538 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.746688 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.746844 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.747087 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.747234 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.747376 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.747517 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.747668 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.747823 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.747966 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.748105 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.748252 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.748401 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.748544 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.748704 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.748846 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.749008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.749201 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.749360 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.749505 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.749914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.750155 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.750308 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.750548 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.750705 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.750857 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.751007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.751156 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.751297 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.751456 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.751597 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.751597 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.751880 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.752043 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.752193 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.752383 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.752536 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.752687 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.752830 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.753067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.753255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.753412 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.753570 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.753738 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.754052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.754210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.754360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.754502 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.754642 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.754791 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.754942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.755083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.755231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.755379 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.755544 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.755686 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.755833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.755989 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.756131 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.756271 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.756500 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.756647 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.756796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.756951 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.757111 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.757374 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.757530 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.757694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.757836 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.757990 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.758134 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.758280 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.758428 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.758569 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.758717 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.758871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.759013 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.759162 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.759312 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.759453 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.759617 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.759784 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.760158 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.760307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.760457 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.760688 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.760849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.760992 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.761140 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.761318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.761468 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.761609 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.761759 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.761920 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.762071 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.762220 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.762405 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.762560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.762718 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.762868 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.763010 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.763248 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.763404 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.763556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.763711 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.763853 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.764106 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.764333 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.764490 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.764642 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.764792 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.764933 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 19:58:41.765082 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.765314 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.765460 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.765669 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.765819 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.765969 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.766129 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.766286 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.766447 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.767522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.767685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.767829 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.767977 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.768126 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.768277 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.768425 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.768576 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.768724 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.768872 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.769033 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.769212 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.769360 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.769509 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.769664 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.769818 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.769959 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.770440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.770602 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.770842 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.770989 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.771132 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.771280 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.771442 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.771584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.771726 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.771874 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.772031 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.772186 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.772328 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.772525 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.772673 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.772816 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.772958 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.773106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.773362 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.773510 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.773652 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.773804 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.773946 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.774113 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.774356 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.774604 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.774752 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.774902 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.775045 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.775271 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.775422 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.775581 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.775730 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.775879 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.776029 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.776179 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.776321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.776468 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.776610 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.776750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.776899 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.776899 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.777216 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.777382 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.777685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.777840 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.777997 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.778140 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.778287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.778437 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.778579 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.778727 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.778877 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.779020 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.779161 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.779302 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.779442 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.779606 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.779754 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.779896 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.780044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.780204 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.780579 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.780579 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.780952 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.781108 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.781303 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.781447 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.781598 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.781768 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.781910 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.782067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.782067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.782344 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.782486 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.782683 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.782683 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.782979 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.783121 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.783263 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.783263 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.786353 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.786530 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.786696 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.786853 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.786998 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.786998 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.787269 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.787420 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.787570 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.787883 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.788028 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.788181 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.788323 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.788473 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.788635 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.788786 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.788944 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.789094 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.789259 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.789403 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.789558 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.789700 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.789860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.790081 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.790241 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.790385 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.790780 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.790961 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.791177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.791332 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.791481 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.791632 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.791785 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.791934 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.792079 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.792229 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.792377 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.792526 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.792727 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.792885 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.793035 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.793143 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.793292 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.793378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.793488 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.793583 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.793677 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.793769 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.793854 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.793952 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.794047 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.794133 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.794218 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.794310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.794394 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.794486 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.794571 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.794662 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.794755 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.794847 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.794941 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.795027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.795127 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.795222 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.795222 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.795391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.795489 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.795582 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.795674 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.795759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.795842 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.795933 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.796026 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.796363 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.796449 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.796533 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.796616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.796711 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.796805 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.796946 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.797043 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.797136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.797252 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.797350 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.797449 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.797542 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.797627 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.797725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.797970 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.798069 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.798163 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.798250 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.798334 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.798426 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.798519 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.798616 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.798710 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.798797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.798888 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.798972 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799064 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799157 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799243 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799326 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799410 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799501 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799593 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799691 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799777 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799777 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799945 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799945 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799945 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799945 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.799945 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.800377 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.800476 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.800476 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.800476 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.800476 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.800476 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.800476 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.801294 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.801294 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.801460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.801460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.801460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.801460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.801777 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.801871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.801871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.801871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.801871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.801871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.802261 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.802354 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.802354 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.802354 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.802354 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.802671 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.802871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.802871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.802871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.802871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.803193 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.803285 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.803285 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.803285 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.803285 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.803606 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.803699 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.803699 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.803958 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.804222 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.804325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.804593 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.804805 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.804896 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.805215 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.805408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.805537 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.805853 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.806000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.806238 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.806580 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.806675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.806762 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.807041 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.807141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.807341 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.807637 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.807737 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.807989 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.808212 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.808306 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.808605 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.808784 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.808877 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.809123 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.809394 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.809498 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.809734 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.809984 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.810077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.810351 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.810562 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.810654 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.811012 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.811125 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.811272 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.811618 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.812080 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.812240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.812347 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.812454 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.812741 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.812963 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.813213 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.813328 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.813572 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.813829 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.814029 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.814480 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.814589 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.814775 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.814926 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.815110 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.815452 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.815615 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.815755 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.816103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.816246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.816603 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.816710 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.816908 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.817392 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.817524 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.817713 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.818145 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.818262 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.818351 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.818706 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.818826 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.819036 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.819274 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.819378 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.819678 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.819857 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.820005 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.820312 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.820402 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.820618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.821039 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.821291 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.821391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.821517 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.821613 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.821841 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.822097 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.822431 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.822595 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.822759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.823072 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.823186 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.823386 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.823670 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.823763 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.824004 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.824240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.824333 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.824722 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.824838 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.825007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.825330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.825454 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.825636 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.827465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.827599 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.827599 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.828408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.828528 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.828626 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.828712 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.828815 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.828909 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.829004 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.829004 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.829184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.829184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.829184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.829184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.829509 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.830028 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.830028 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.830328 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.830642 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.830946 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.831272 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.831576 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.831878 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.832176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.832477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.832820 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.833123 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.833486 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.833816 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.834598 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.834598 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.834786 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.835081 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.835382 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.835685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.836441 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.836441 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.837205 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.837498 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.837819 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.838167 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.838708 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.838815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.839079 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.839388 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.839858 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.840177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.840485 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.840786 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.840888 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.841088 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.841426 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.841731 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.842015 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.842127 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.842320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.842793 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.843530 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.843627 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.843751 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.843751 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.843920 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.844136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.844439 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.844583 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.844738 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.845099 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.845460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.845575 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.845777 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.846064 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.846371 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.846674 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.846970 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.847090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.847267 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.847585 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.847870 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.847963 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.848188 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.848590 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.848862 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.848967 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.849741 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.849741 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.849960 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.850058 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.850153 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.850247 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.850334 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.850568 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.850864 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.851164 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.851520 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.851783 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.852087 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.852279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.852667 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.853010 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.853362 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.853456 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.853852 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.853973 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.854366 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.854477 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.854575 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.854986 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.855110 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.855799 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.855799 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.855999 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.856090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.856377 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.856844 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.857226 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.857352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.857579 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.857888 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.858211 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.858390 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.858544 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.858804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.858981 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.858981 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.859340 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.859593 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.859593 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.859857 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.859999 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.860136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.860272 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.860454 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.860696 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.860846 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.860984 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.861132 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.862227 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.862227 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.862400 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.862587 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.863362 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.863362 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.863362 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.863781 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.863931 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.864069 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.864167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.864252 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.864902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.864902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.865205 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.865344 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.865502 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.865640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.865777 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.865913 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.866069 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.866207 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.866364 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.866503 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.866651 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.866811 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.866947 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.866947 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.867340 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.867558 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.867664 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.867810 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.867953 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.868098 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.868606 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.868754 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.868965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.869059 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.869283 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.869433 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.869572 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.869710 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.869847 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.869995 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.870090 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.870275 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.870275 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.870507 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.870664 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.870768 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.870862 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.870957 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.871050 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.871142 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.871235 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.871319 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.871390 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.871486 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.871578 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.871662 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.871923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.872033 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.872130 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.872224 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.872361 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.872455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.872666 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.872758 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.872970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.873085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.873305 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.873431 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.873628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.873720 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.873933 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.874047 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.874236 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.874464 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.874558 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.874790 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.874909 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.875159 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.875259 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.875479 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.875586 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.875805 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.875897 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.876113 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.876212 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.876417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.876525 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.876726 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.876878 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.877029 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.877260 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.877393 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.877518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.877724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.877882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.878032 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.878173 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.878337 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.878475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.878635 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.878773 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.878957 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.879095 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.879311 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.879398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.880341 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.880451 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.880537 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.880639 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.880738 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.880824 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.880915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.880915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.881170 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.881574 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.881893 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.882205 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.882514 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.882726 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.882844 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.885173 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.885320 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.885427 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.885427 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.885427 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.885427 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.885756 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.885840 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.885913 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.886013 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.886093 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.886093 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.886093 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.886312 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.886644 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.886829 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.887040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.887204 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.887377 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.887524 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.887699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.887917 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.888072 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.888228 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.888377 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.888515 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.888652 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.888789 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.888936 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.889090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.889259 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.889398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.889534 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.889669 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.889808 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.889962 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.890101 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.890248 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.890390 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.890534 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.890815 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.890970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.891126 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.891275 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.891417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.891557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.891710 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.891850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.892014 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.892247 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.892397 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.892547 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.892693 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.892840 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.893002 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.893168 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.893308 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.893458 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.893595 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.893692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.893865 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.893994 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.894162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.894283 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.894494 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.894608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.894806 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.894927 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.895125 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.895240 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.895442 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.895553 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.895748 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.895901 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.896069 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.896228 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.896377 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.896518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.896666 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.896820 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.896961 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.897108 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.897309 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.897459 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.897609 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.897768 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.897912 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.898049 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.898190 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.898338 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.898479 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.898619 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.898783 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.898930 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.899067 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.899215 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.899376 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.899524 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.899796 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.899967 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.900107 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.900263 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.900425 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.900622 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.900790 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.900933 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.901073 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.901266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.901419 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.901567 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.901718 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.901863 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.902001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.902139 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.902372 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.902523 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.902667 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.902820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.902961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.903108 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.903256 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.903404 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.903544 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.903702 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.903839 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.903980 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.904135 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.904284 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.904422 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.904577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.904725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.904864 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.905011 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.905100 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.905414 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.905524 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.905675 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.905803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.905924 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.906069 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.906262 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.906394 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.906602 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.906872 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.907026 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.907263 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.907410 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.907645 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.907911 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.908097 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.908381 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.908494 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.908742 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.908969 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.909265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.909523 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.909743 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.909966 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.910120 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.910266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.910438 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.910595 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.910757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.911053 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.911188 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.911359 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.911606 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.911745 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.911993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.912225 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.912534 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.912679 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.912837 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.912837 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.913111 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.913275 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.913458 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.913599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.913770 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.914057 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.914209 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.914405 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.914637 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.914851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.915079 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.915330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.915560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.915779 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.916000 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.916227 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.916374 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.916540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.916633 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.916633 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.916787 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.916906 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.917136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.917275 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.917590 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.917730 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.917907 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.918219 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.918323 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.918529 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.918623 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.918839 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.918945 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.919150 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.919249 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.919462 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.919563 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.919770 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.919892 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.920090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.920191 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.920401 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.920500 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.920711 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.920846 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.921034 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.921126 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.921385 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.921477 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.921699 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.921973 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.922080 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.922325 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.922417 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.922650 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.922867 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.922970 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.923180 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.923309 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.923986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.924114 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.924220 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.924317 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.924403 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.924487 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.924579 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.924678 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.924754 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.924951 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.925049 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.925144 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.925386 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.925560 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.925710 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.925861 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.926010 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.926159 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.926306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.926459 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.926599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.926749 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.926895 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.927042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.927195 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.927342 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.927480 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.927582 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.927836 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.928004 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.928240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.928383 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.928603 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.928762 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.928903 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.929048 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.929224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.929362 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.929509 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.929657 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.929802 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.929943 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.930092 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.930266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.930360 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.930570 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.930671 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.930874 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.930965 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.931182 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.931305 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.931487 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.931589 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.931791 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.931883 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.932095 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.932188 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.932394 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.932484 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.932695 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.932800 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.932998 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.933099 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.933326 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.933419 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.933627 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.933716 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.933966 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.934069 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.934232 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.934361 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.934586 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.934770 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.934932 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.935199 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.935344 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.935539 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.935681 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.935832 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.935974 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.936111 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.936251 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.936407 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.936544 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.936697 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.936837 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.936985 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.937144 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.937310 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.937471 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.937593 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.937748 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.937850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.938056 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.938158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.938360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.938462 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.938664 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.938765 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.938986 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.939080 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.939293 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.939384 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.939599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.939702 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.939906 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.939999 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.940213 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.940306 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.940520 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.940612 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.940825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.940918 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.941130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.941249 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.941458 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.941566 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.941762 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.941860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.942065 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.942184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.942372 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.942499 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.942746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.942979 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.943082 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.943287 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.943387 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.943598 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.943692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.943944 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.944044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.944250 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.944426 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.944563 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.944656 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.944863 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.944962 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.945186 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.945361 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.945511 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.945618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.945820 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.945913 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.946124 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.946228 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.946429 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.946521 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.946737 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.946827 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.947043 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.947144 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.947349 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.947448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.947650 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.947741 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.947954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.948072 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.948262 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.948372 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.948568 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.948698 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.948877 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.949000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.949202 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.949347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.949512 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.949668 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.949819 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.949986 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.950135 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.950290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.950475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.950604 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.950790 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.950911 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.951105 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.951241 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.951416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.951643 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.951811 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.951968 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.952113 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.952255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.952414 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.952568 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.952713 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.952823 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.953082 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.953291 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.953442 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.953593 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.953733 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.953882 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.954019 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.954160 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.954310 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.954461 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.954608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.954747 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.954894 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.955034 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.955212 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.955364 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.955521 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.955679 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.955890 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.956048 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.956188 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.956328 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.956486 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.956634 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.956775 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.956925 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.957084 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.957188 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.957313 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.957408 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.957627 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.957739 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.957914 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.958015 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.958217 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.958317 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.958525 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.958701 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.958848 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.958997 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.959147 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.959288 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.959439 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.959579 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.959718 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.959857 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.959997 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.960153 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.960305 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.960447 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.960586 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.960727 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.960898 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.961040 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.961217 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.961386 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.961522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.961660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.961806 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.961927 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.962107 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.962208 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.962409 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.962503 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.962713 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.962821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.963012 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.963136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.963310 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.963453 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.963595 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.963749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.963904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.964044 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.964184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.964329 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.964469 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.964618 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.964759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.964910 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.965049 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.965222 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.965374 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.965523 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.965662 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.965765 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.965933 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.966099 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.966254 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.966395 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.966535 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.966681 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.966852 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.966994 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.967165 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.967306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.967483 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.967641 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.967789 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.967928 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.968090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.968238 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.968386 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.968525 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.968713 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.968833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.969028 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.969129 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.969364 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.969466 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.969669 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.969771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.969978 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.970069 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.970283 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.970383 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.970586 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.970686 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.970890 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.971008 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.971194 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.971286 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.971514 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.971881 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.972038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.972187 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.972338 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.972479 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.972741 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.972891 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.973032 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.973135 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.973304 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.973457 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.973603 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.973755 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.973896 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.974044 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.974183 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.974360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.974460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.974670 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.974762 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.974970 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.975061 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.975210 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 19:58:41.975304 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.975576 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.975882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.976190 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.976492 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.976802 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.977106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.977436 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.977748 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.978060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.978383 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.978707 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.979010 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.979330 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.979652 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.980002 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.980312 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.980649 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.980975 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.981340 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.981648 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.981948 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 19:58:41.982187 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 19:58:42.035067 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO dbcounter [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] Registered counter for database nova_api Jul 31 19:58:42.041861 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] Registered counter for database nova_api Jul 31 19:58:42.055974 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_db.sqlalchemy.engines [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:58:42.061771 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:58:42.063292 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writer thread running {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:58:42.068388 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:58:42.118149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.context [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cdcc5c53-df39-4ee3-bc4a-be549d4d611a(cell1) {{(pid=117919) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 19:58:42.122613 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:58:42.124195 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:58:42.125010 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:58:42.125501 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.context [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cdcc5c53-df39-4ee3-bc4a-be549d4d611a(cell1) {{(pid=117920) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 19:58:42.127095 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:58:42.129065 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO dbcounter [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] Registered counter for database nova_cell0 Jul 31 19:58:42.129558 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:58:42.131144 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:58:42.131934 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:58:42.133406 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO dbcounter [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] Registered counter for database nova_cell1 Jul 31 19:58:42.133946 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:58:42.135926 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] Registered counter for database nova_cell0 Jul 31 19:58:42.139898 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] Registered counter for database nova_cell1 Jul 31 19:58:42.141485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_db.sqlalchemy.engines [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:58:42.142785 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_db.sqlalchemy.engines [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:58:42.147805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:58:42.149416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:58:42.149704 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writer thread running {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:58:42.151292 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writer thread running {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:58:42.155550 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:58:42.157057 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:58:42.295886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO dbcounter [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] Registered counter for database nova_cell0 Jul 31 19:58:42.301677 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] Registered counter for database nova_cell0 Jul 31 19:58:42.302918 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_db.sqlalchemy.engines [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:58:42.307800 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writer thread running {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:58:42.308270 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 19:58:42.312887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 19:58:42.621660 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 19:58:42.621982 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: WARNING keystonemiddleware.auth_token [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 19:58:42.629579 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 19:58:42.629742 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: WARNING keystonemiddleware.auth_token [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 19:58:42.973176 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: WARNING keystonemiddleware.auth_token [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 19:58:42.975290 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 19:58:42.979402 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: WARNING keystonemiddleware.auth_token [None req-41bbd84f-43de-4073-aa1f-a84fc505a82e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 19:58:42.981359 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-0647f728-3733-44a6-9115-a6e5b3d6549c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 19:58:42.985015 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55683ea059c0 pid: 117919 (default app) Jul 31 19:58:42.986730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55683ea059c0 pid: 117920 (default app) Jul 31 19:59:24.100693 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:59:24.101670 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:59:24.102552 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:59:24.103574 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:59:25.183277 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1f3641ef-5967-48d9-b91b-532117ac2bea tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] Action: 'create', calling method: .version_select at 0x7ffa267b1ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1776454261", "metadata": {"Type": "work"}}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:59:27.027527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1f3641ef-5967-48d9-b91b-532117ac2bea tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.943805 Jul 31 19:59:27.029739 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1156 bytes} [Sun Jul 31 19:59:24 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2947 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 31 19:59:27.054955 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:59:27.055641 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:59:27.058967 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:59:27.065444 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:59:27.344590 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-78d0efbd-3865-4f3c-8e54-e526227070c8 tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] Calling method '.version_select at 0x7ffa267aa9d0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:28.372736 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-78d0efbd-3865-4f3c-8e54-e526227070c8 tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f029ceae-8be8-46f1-9adb-8066717eaf21" status: 200 len: 354 microversion: 2.1 time: 1.326507 Jul 31 19:59:28.373459 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 1/2] 10.222.0.48 () {58 vars in 1245 bytes} [Sun Jul 31 19:59:27 2022] GET /compute/v2.1/os-volumes/f029ceae-8be8-46f1-9adb-8066717eaf21 => generated 354 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:59:28.387963 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-760c65a7-9ee3-4485-9cb7-9a822c71f7df tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] Calling method '.version_select at 0x7ffa26635d30>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:28.495816 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-760c65a7-9ee3-4485-9cb7-9a822c71f7df tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f029ceae-8be8-46f1-9adb-8066717eaf21" status: 200 len: 354 microversion: 2.1 time: 0.113300 Jul 31 19:59:28.498408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1245 bytes} [Sun Jul 31 19:59:28 2022] GET /compute/v2.1/os-volumes/f029ceae-8be8-46f1-9adb-8066717eaf21 => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:59:28.516939 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c327d5ac-eaf6-48cb-b6be-1419ffb6f6a0 tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] Calling method '.version_select at 0x7ffa2666cd30>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:28.708848 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c327d5ac-eaf6-48cb-b6be-1419ffb6f6a0 tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/f029ceae-8be8-46f1-9adb-8066717eaf21" status: 202 len: 0 microversion: 2.1 time: 0.196220 Jul 31 19:59:28.717639 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6a1f7160-149f-4b06-a4a4-886e252a461d tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] Calling method '.version_select at 0x7ffa26646430>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:28.721234 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1248 bytes} [Sun Jul 31 19:59:28 2022] DELETE /compute/v2.1/os-volumes/f029ceae-8be8-46f1-9adb-8066717eaf21 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 19:59:28.820576 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6a1f7160-149f-4b06-a4a4-886e252a461d tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f029ceae-8be8-46f1-9adb-8066717eaf21" status: 200 len: 353 microversion: 2.1 time: 0.106655 Jul 31 19:59:28.821569 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 3/5] 10.222.0.48 () {58 vars in 1245 bytes} [Sun Jul 31 19:59:28 2022] GET /compute/v2.1/os-volumes/f029ceae-8be8-46f1-9adb-8066717eaf21 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:59:29.838957 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c78b6389-c714-42a7-8648-ee922bf826f2 tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] Calling method '.version_select at 0x7ffa2662b430>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:29.892893 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-c78b6389-c714-42a7-8648-ee922bf826f2 tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] HTTP exception thrown: Volume f029ceae-8be8-46f1-9adb-8066717eaf21 could not be found. Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c78b6389-c714-42a7-8648-ee922bf826f2 tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] Request method failure captured: Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/os-volumes/f029ceae-8be8-46f1-9adb-8066717eaf21 HTTP/1.1 Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8bAt_YuGUEh7eyvjhvglsIppJIYVomMqE83-zQP91njVNTKl5kU7uZze3q_TSZD3c8yAVvWZuMvT9vlR_0gTmv2lDSOxjDAMw6Lv-BuYd3FSZlUfPlI9TaYlWc9NDivEmkaJNoicwEJ4JqIolSRx8JkPloJYXzHmPodFpzBPnS-_M Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 5089d76632494557906fd2d39b40adc9 Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesGetTestJSON-366401260 Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 19:59:29.897506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 19:59:29.898574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5089d76632494557906fd2d39b40adc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5089d76632494557906fd2d39b40adc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5089d76632494557906fd2d39b40adc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5089d76632494557906fd2d39b40adc9"}]}] Jul 31 19:59:29.898574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesGetTestJSON-366401260 Jul 31 19:59:29.898574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 5089d76632494557906fd2d39b40adc9 Jul 31 19:59:29.898574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesGetTestJSON-366401260 Jul 31 19:59:29.898574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesGetTestJSON-366401260-project Jul 31 19:59:29.898574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 19:59:29.898574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 19:59:29.898574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 914d5ad6cd0b4efc95aebb7a6fc5d049 Jul 31 19:59:29.898574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesGetTestJSON-366401260-project Jul 31 19:59:29.898574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: Jul 31 19:59:29.898574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Volume f029ceae-8be8-46f1-9adb-8066717eaf21 could not be found. Jul 31 19:59:29.898574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': 'f029ceae-8be8-46f1-9adb-8066717eaf21'} Jul 31 19:59:29.898574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f029ceae-8be8-46f1-9adb-8066717eaf21 could not be found. (HTTP 404) (Request-ID: req-b01fd564-b4e7-4ef4-b5d9-8431ff54ad41) Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:59:29.899224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 19:59:29.900122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f029ceae-8be8-46f1-9adb-8066717eaf21 could not be found. Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 19:59:29.900973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 19:59:29.901842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f029ceae-8be8-46f1-9adb-8066717eaf21 could not be found. Jul 31 19:59:29.901842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 19:59:29.901842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 19:59:29.901842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 19:59:29.901842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 19:59:29.901842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 19:59:29.901842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 19:59:29.901842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 19:59:29.901842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 19:59:29.901842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f029ceae-8be8-46f1-9adb-8066717eaf21 could not be found. Jul 31 19:59:29.901842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 19:59:29.907486 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c78b6389-c714-42a7-8648-ee922bf826f2 tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] Returning 404 to user: Volume f029ceae-8be8-46f1-9adb-8066717eaf21 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 19:59:29.908557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c78b6389-c714-42a7-8648-ee922bf826f2 tempest-VolumesGetTestJSON-366401260 tempest-VolumesGetTestJSON-366401260-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f029ceae-8be8-46f1-9adb-8066717eaf21" status: 404 len: 109 microversion: 2.1 time: 0.075258 Jul 31 19:59:29.913351 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 3/6] 10.222.0.48 () {58 vars in 1245 bytes} [Sun Jul 31 19:59:29 2022] GET /compute/v2.1/os-volumes/f029ceae-8be8-46f1-9adb-8066717eaf21 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 19:59:37.227200 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ce118000-4bfc-480a-8d89-cd908a4534a7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Action: 'create', calling method: .version_select at 0x7ffa26646a60>, body: {"keypair": {"name": "tempest-keypair-341324256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjIFaq3fJRlXWSnekw6F7haaMP3ewS71AlWIQ44ANf5RMm6JZFVhLpYRQo2+dEFEXDZkSCDUcTpApGA6QnUDC9RBX/2oRtye04JkXX6+WKRre2qLxgtXVNQ6BtLmS2m2w=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:59:37.326310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-ce118000-4bfc-480a-8d89-cd908a4534a7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Getting quotas for project aed33078067c4aa3b0e1d1bf79fd379d. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 19:59:37.338727 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-ce118000-4bfc-480a-8d89-cd908a4534a7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Getting quotas for user 008286f78ee44232bf411bd695f0c0ed and project aed33078067c4aa3b0e1d1bf79fd379d. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 19:59:37.434968 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ce118000-4bfc-480a-8d89-cd908a4534a7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.803549 Jul 31 19:59:37.435648 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 4/7] 10.222.0.48 () {62 vars in 1200 bytes} [Sun Jul 31 19:59:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 806 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 31 19:59:40.258798 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fb65d332-f8f9-4b5f-8574-01796d7d7b5d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Action: 'create', calling method: .version_select at 0x7ffa26610430>, body: {"keypair": {"name": "tempest-keypair-1358567791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC+KR+VHWWihPqvMx3/jdvONc2KJJAJvABEI6bqKJGgCMWmev6bTqq3Wm/sfLwExt1T/Hv8uVMhmBjLeyyDK3tYEEn33zd2urmrLzSCHnVcQJdcOkasg2zjUaWDzfTQhQ=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:59:40.369805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-fb65d332-f8f9-4b5f-8574-01796d7d7b5d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for project 2f435e60769a43deb3c15b351f97d62c. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 19:59:40.385470 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-fb65d332-f8f9-4b5f-8574-01796d7d7b5d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for user 76b9c24c8dc94af8b2c8e44be8494e9b and project 2f435e60769a43deb3c15b351f97d62c. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 19:59:40.501899 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fb65d332-f8f9-4b5f-8574-01796d7d7b5d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.434612 Jul 31 19:59:40.510747 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 4/8] 10.222.0.48 () {60 vars in 1159 bytes} [Sun Jul 31 19:59:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:59:41.036931 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9083fe7a-c585-4013-8a3c-3daf0113fbbe tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Action: 'create', calling method: .version_select at 0x7ffa26621b80>, body: {"keypair": {"name": "tempest-keypair-1901587645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBn94behJLpY58mVpJBxR9z+qHtbwVd0dE+Iz8LTMo66gWg4uvt7C+PRXCLsO+/OrStssp8TXT7PWYusFL6vaqi/PQt1DrDSFRououkZx6n7HFcRKnME6YjAso6QpzfIHg=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:59:41.062503 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-9083fe7a-c585-4013-8a3c-3daf0113fbbe tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Getting quotas for project ebb02d5d721347988f4eaff1bb027dcf. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 19:59:41.067381 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-9083fe7a-c585-4013-8a3c-3daf0113fbbe tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Getting quotas for user 83717eeddd7347209a660ce46877d41d and project ebb02d5d721347988f4eaff1bb027dcf. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 19:59:41.104022 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9083fe7a-c585-4013-8a3c-3daf0113fbbe tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130993 Jul 31 19:59:41.114906 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 5/9] 10.222.0.48 () {60 vars in 1159 bytes} [Sun Jul 31 19:59:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 19:59:43.446063 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-85817638", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68dcf029-54c5-4da0-972e-7f6fa1d3a796"}], "security_groups": [{"name": "tempest-securitygroup--1424367039"}], "key_name": "tempest-keypair-341324256", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:59:44.202175 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] validate_networks() for [('68dcf029-54c5-4da0-972e-7f6fa1d3a796', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 19:59:45.300671 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-929224366", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:59:45.553532 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] validate_networks() for [('53f36ad7-07fc-4450-bca6-30cfbe8fbc79', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 19:59:47.810620 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 19:59:47.811164 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 19:59:47.811567 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 19:59:47.811976 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 19:59:47.812425 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 19:59:47.829902 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:47.833762 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:47.835001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:47.835611 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:47.878006 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Getting quotas for project aed33078067c4aa3b0e1d1bf79fd379d. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 19:59:47.885789 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Getting quotas for user 008286f78ee44232bf411bd695f0c0ed and project aed33078067c4aa3b0e1d1bf79fd379d. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 19:59:47.901879 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 19:59:47.905465 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 19:59:48.020927 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d3752caf-0e3b-4587-948f-b09890e4bae3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.583269 Jul 31 19:59:48.030916 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 5/10] 10.222.0.48 () {62 vars in 1188 bytes} [Sun Jul 31 19:59:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 4595 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 19:59:48.051356 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-946432700", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "758cb11a-528c-4227-88a9-030f838941a5"}], "security_groups": [{"name": "tempest-securitygroup--1916466427"}], "key_name": "tempest-keypair-1358567791", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:59:48.066932 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 19:59:48.067475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 19:59:48.067852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 19:59:48.068257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 19:59:48.068674 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 19:59:48.086379 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:48.087872 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:48.088830 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:48.089830 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:48.132056 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Getting quotas for project 41f4d4561f4f40f8b370b8cc943c97af. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 19:59:48.184226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Getting quotas for user 89abc5820b584315a8413f6402f7ff1f and project 41f4d4561f4f40f8b370b8cc943c97af. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 19:59:48.203439 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 19:59:48.211012 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 19:59:48.446712 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-769a94da-cf92-4bc6-9c8b-adb3e0016a00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.560146 Jul 31 19:59:48.468734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 6/11] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 19:59:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 3578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 19:59:48.528572 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] validate_networks() for [('758cb11a-528c-4227-88a9-030f838941a5', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 19:59:48.990381 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-267097742", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "networks": [{"uuid": "83dce77d-65c9-4b96-b285-b9f246c68b9a"}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:59:49.188372 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] validate_networks() for [('83dce77d-65c9-4b96-b285-b9f246c68b9a', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 19:59:50.065292 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 19:59:50.065790 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 19:59:50.066158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 19:59:50.066563 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 19:59:50.066961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 19:59:50.084356 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:50.087470 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:50.089073 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:50.093776 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:50.146139 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for project 2f435e60769a43deb3c15b351f97d62c. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 19:59:50.152857 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for user 76b9c24c8dc94af8b2c8e44be8494e9b and project 2f435e60769a43deb3c15b351f97d62c. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 19:59:50.184451 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 19:59:50.191692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 19:59:50.272817 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b35c6a02-da77-4c1c-851a-ac3a39bc8a84 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.239882 Jul 31 19:59:50.276756 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 6/12] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 19:59:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 19:59:50.296980 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-08bc5858-28b5-48ea-9009-3409abe1b386 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:50.310761 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-08bc5858-28b5-48ea-9009-3409abe1b386 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:50.322688 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 19:59:50.323948 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 19:59:50.324614 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 19:59:50.325260 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 19:59:50.325969 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 19:59:50.342829 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:50.343506 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:50.344831 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:50.345432 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:50.362652 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08bc5858-28b5-48ea-9009-3409abe1b386 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:50.366333 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Getting quotas for project 7ac9cd175c5b423389779d2f4f487287. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 19:59:50.371261 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Getting quotas for user 40ae686b7ff04508a6cfb6723f5d0f70 and project 7ac9cd175c5b423389779d2f4f487287. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 19:59:50.386301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 19:59:50.389092 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 19:59:50.389626 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08bc5858-28b5-48ea-9009-3409abe1b386 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:50.391147 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08bc5858-28b5-48ea-9009-3409abe1b386 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:50.391604 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08bc5858-28b5-48ea-9009-3409abe1b386 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:50.471700 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b593a69c-62dc-41a2-b00f-1b6f206d19e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.001546 Jul 31 19:59:50.472351 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 7/13] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 19:59:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 19:59:50.485284 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e96df171-8b92-4f14-aafa-65d81e735150 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:50.486126 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e96df171-8b92-4f14-aafa-65d81e735150 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:50.504420 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e96df171-8b92-4f14-aafa-65d81e735150 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:50.505118 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e96df171-8b92-4f14-aafa-65d81e735150 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:50.506054 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e96df171-8b92-4f14-aafa-65d81e735150 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:50.507279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e96df171-8b92-4f14-aafa-65d81e735150 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:50.724734 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-08bc5858-28b5-48ea-9009-3409abe1b386 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:50.778144 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-08bc5858-28b5-48ea-9009-3409abe1b386 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:50.781901 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-08bc5858-28b5-48ea-9009-3409abe1b386 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:50.789111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-08bc5858-28b5-48ea-9009-3409abe1b386 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1283 microversion: 2.20 time: 0.510963 Jul 31 19:59:50.791264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 7/14] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 19:59:50 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1283 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:59:50.799641 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1682722922", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47480458-3271-41da-9c92-4450622fa327"}], "security_groups": [{"name": "tempest-securitygroup--66315242"}], "key_name": "tempest-keypair-1901587645", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:59:51.180221 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e96df171-8b92-4f14-aafa-65d81e735150 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:51.215975 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] validate_networks() for [('47480458-3271-41da-9c92-4450622fa327', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 19:59:51.241097 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e96df171-8b92-4f14-aafa-65d81e735150 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1217 microversion: 2.1 time: 0.759749 Jul 31 19:59:51.242454 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 8/15] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:50 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1217 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:51.285580 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4c309f35-d8f3-4c3e-aa2a-9f9ebc382aac tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:51.289548 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4c309f35-d8f3-4c3e-aa2a-9f9ebc382aac tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:51.619630 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4c309f35-d8f3-4c3e-aa2a-9f9ebc382aac tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:51.649656 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4c309f35-d8f3-4c3e-aa2a-9f9ebc382aac tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1241 microversion: 2.1 time: 0.388116 Jul 31 19:59:51.650858 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 9/16] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:51 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1241 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:51.656362 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-624156ca-9b26-45ac-80dd-f511622d85b7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:51.656971 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-624156ca-9b26-45ac-80dd-f511622d85b7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:51.664080 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-624156ca-9b26-45ac-80dd-f511622d85b7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:51.665659 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-624156ca-9b26-45ac-80dd-f511622d85b7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:51.666672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-624156ca-9b26-45ac-80dd-f511622d85b7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:51.667475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-624156ca-9b26-45ac-80dd-f511622d85b7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:51.834892 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-624156ca-9b26-45ac-80dd-f511622d85b7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:51.843099 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-624156ca-9b26-45ac-80dd-f511622d85b7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1218 microversion: 2.1 time: 0.190757 Jul 31 19:59:51.850587 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 10/17] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:51 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:51.856064 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-633152453", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 19:59:51.939465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] validate_networks() for [('53f36ad7-07fc-4450-bca6-30cfbe8fbc79', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 19:59:52.133448 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 19:59:52.134518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 19:59:52.135007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 19:59:52.135470 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 19:59:52.135818 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 19:59:52.148435 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:52.148881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:52.149929 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:52.151105 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:52.173868 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Getting quotas for project ebb02d5d721347988f4eaff1bb027dcf. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 19:59:52.178115 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Getting quotas for user 83717eeddd7347209a660ce46877d41d and project ebb02d5d721347988f4eaff1bb027dcf. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 19:59:52.192379 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 19:59:52.194786 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 19:59:52.298176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f12c5c68-796e-4a03-8a4f-d9a94c9c9283 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.505521 Jul 31 19:59:52.299986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 8/18] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 19:59:50 2022] POST /compute/v2.1/servers => generated 400 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 19:59:52.311845 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fc3a9efe-8d59-4bb9-a00c-adef507a97c4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:52.312707 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fc3a9efe-8d59-4bb9-a00c-adef507a97c4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:52.328601 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc3a9efe-8d59-4bb9-a00c-adef507a97c4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:52.329068 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc3a9efe-8d59-4bb9-a00c-adef507a97c4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:52.329881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc3a9efe-8d59-4bb9-a00c-adef507a97c4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:52.330318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc3a9efe-8d59-4bb9-a00c-adef507a97c4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:52.424744 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fc3a9efe-8d59-4bb9-a00c-adef507a97c4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:52.439237 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fc3a9efe-8d59-4bb9-a00c-adef507a97c4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:52.445911 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fc3a9efe-8d59-4bb9-a00c-adef507a97c4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:52.449109 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fc3a9efe-8d59-4bb9-a00c-adef507a97c4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1331 microversion: 2.20 time: 0.147893 Jul 31 19:59:52.454965 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 9/19] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 19:59:52 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1331 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:59:52.461425 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-233193b8-3880-44af-b14b-42e7eac626bd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:52.462049 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-233193b8-3880-44af-b14b-42e7eac626bd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:52.568303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-233193b8-3880-44af-b14b-42e7eac626bd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:52.581352 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-233193b8-3880-44af-b14b-42e7eac626bd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1238 microversion: 2.1 time: 0.124848 Jul 31 19:59:52.582212 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 10/20] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:52 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1238 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:52.605996 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 19:59:52.606628 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 19:59:52.607289 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 19:59:52.607715 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 19:59:52.608199 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 19:59:52.619937 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:52.620636 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:52.622694 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:52.623199 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:52.644760 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Getting quotas for project 41f4d4561f4f40f8b370b8cc943c97af. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 19:59:52.649721 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Getting quotas for user 89abc5820b584315a8413f6402f7ff1f and project 41f4d4561f4f40f8b370b8cc943c97af. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 19:59:52.661431 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 19:59:52.663562 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 19:59:52.671210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fa9b1c6d-5372-4f9f-8109-e653c3e4cb26 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:52.671993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fa9b1c6d-5372-4f9f-8109-e653c3e4cb26 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:52.680281 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa9b1c6d-5372-4f9f-8109-e653c3e4cb26 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:52.680953 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa9b1c6d-5372-4f9f-8109-e653c3e4cb26 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:52.682101 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa9b1c6d-5372-4f9f-8109-e653c3e4cb26 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:52.682788 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa9b1c6d-5372-4f9f-8109-e653c3e4cb26 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:52.727340 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-27586255-1a57-476a-a490-a8c4b6290a7e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.875293 Jul 31 19:59:52.728717 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 11/21] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 19:59:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 19:59:52.742847 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b057a75c-dde1-499f-aa8f-da94e67f6ef1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:52.744833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b057a75c-dde1-499f-aa8f-da94e67f6ef1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:52.754818 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fa9b1c6d-5372-4f9f-8109-e653c3e4cb26 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:52.766624 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fa9b1c6d-5372-4f9f-8109-e653c3e4cb26 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1245 microversion: 2.1 time: 0.099584 Jul 31 19:59:52.768479 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 11/22] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:52 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 19:59:52.853245 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b057a75c-dde1-499f-aa8f-da94e67f6ef1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:52.864215 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b057a75c-dde1-499f-aa8f-da94e67f6ef1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1221 microversion: 2.1 time: 0.127908 Jul 31 19:59:52.869199 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:52 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 19:59:52.878225 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-def7655f-8e8c-4ab5-a091-6d708bd8e2a7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:52.878918 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-def7655f-8e8c-4ab5-a091-6d708bd8e2a7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:52.891426 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-def7655f-8e8c-4ab5-a091-6d708bd8e2a7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:52.897934 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-def7655f-8e8c-4ab5-a091-6d708bd8e2a7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:52.900222 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-def7655f-8e8c-4ab5-a091-6d708bd8e2a7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:52.907481 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-def7655f-8e8c-4ab5-a091-6d708bd8e2a7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:52.987468 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-def7655f-8e8c-4ab5-a091-6d708bd8e2a7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:52.995879 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-def7655f-8e8c-4ab5-a091-6d708bd8e2a7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1218 microversion: 2.1 time: 0.122843 Jul 31 19:59:52.996925 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 12/24] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:52 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:53.477340 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8b1a4de5-c41c-444e-8710-8430369bd017 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:53.478039 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8b1a4de5-c41c-444e-8710-8430369bd017 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:53.484511 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b1a4de5-c41c-444e-8710-8430369bd017 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:53.485267 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b1a4de5-c41c-444e-8710-8430369bd017 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:53.486052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b1a4de5-c41c-444e-8710-8430369bd017 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:53.486484 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b1a4de5-c41c-444e-8710-8430369bd017 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:53.567410 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8b1a4de5-c41c-444e-8710-8430369bd017 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:53.575826 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8b1a4de5-c41c-444e-8710-8430369bd017 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:53.577284 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8b1a4de5-c41c-444e-8710-8430369bd017 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:53.578365 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8b1a4de5-c41c-444e-8710-8430369bd017 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1331 microversion: 2.20 time: 0.105007 Jul 31 19:59:53.579150 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 13/25] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 19:59:53 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:59:53.603275 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0ab1dfcf-0cb8-49c4-9fb7-94808c7c063e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:53.604241 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0ab1dfcf-0cb8-49c4-9fb7-94808c7c063e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:53.614430 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab1dfcf-0cb8-49c4-9fb7-94808c7c063e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:53.614881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab1dfcf-0cb8-49c4-9fb7-94808c7c063e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:53.615776 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab1dfcf-0cb8-49c4-9fb7-94808c7c063e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:53.616204 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab1dfcf-0cb8-49c4-9fb7-94808c7c063e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:53.677013 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0ab1dfcf-0cb8-49c4-9fb7-94808c7c063e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:53.684529 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0ab1dfcf-0cb8-49c4-9fb7-94808c7c063e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1242 microversion: 2.1 time: 0.085167 Jul 31 19:59:53.685116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 13/26] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:53 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 19:59:53.794993 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-859435cc-8aa3-4a99-910a-526ee196eac2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:53.795685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-859435cc-8aa3-4a99-910a-526ee196eac2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:53.802324 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-859435cc-8aa3-4a99-910a-526ee196eac2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:53.802754 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-859435cc-8aa3-4a99-910a-526ee196eac2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:53.803505 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-859435cc-8aa3-4a99-910a-526ee196eac2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:53.803927 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-859435cc-8aa3-4a99-910a-526ee196eac2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:53.864870 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-859435cc-8aa3-4a99-910a-526ee196eac2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:53.873325 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-859435cc-8aa3-4a99-910a-526ee196eac2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1245 microversion: 2.1 time: 0.081894 Jul 31 19:59:53.873957 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 14/27] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:53 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:53.886240 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-064c481c-1595-478e-a487-5cb5a967b564 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:53.886968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-064c481c-1595-478e-a487-5cb5a967b564 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:53.893325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-064c481c-1595-478e-a487-5cb5a967b564 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:53.893765 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-064c481c-1595-478e-a487-5cb5a967b564 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:53.894525 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-064c481c-1595-478e-a487-5cb5a967b564 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:53.894960 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-064c481c-1595-478e-a487-5cb5a967b564 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:53.960376 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-064c481c-1595-478e-a487-5cb5a967b564 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:53.968223 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-064c481c-1595-478e-a487-5cb5a967b564 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1225 microversion: 2.1 time: 0.086624 Jul 31 19:59:53.968786 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 14/28] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:53 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:54.019836 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-acfa427d-2113-4d3c-a848-4144836b643a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:54.020569 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-acfa427d-2113-4d3c-a848-4144836b643a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:54.026817 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-acfa427d-2113-4d3c-a848-4144836b643a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:54.027286 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-acfa427d-2113-4d3c-a848-4144836b643a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:54.028055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-acfa427d-2113-4d3c-a848-4144836b643a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:54.028492 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-acfa427d-2113-4d3c-a848-4144836b643a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:54.094686 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-acfa427d-2113-4d3c-a848-4144836b643a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:54.104035 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-acfa427d-2113-4d3c-a848-4144836b643a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1218 microversion: 2.1 time: 0.088599 Jul 31 19:59:54.104649 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 15/29] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:54 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:54.603137 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dec94668-5583-427e-9994-c1179363010a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:54.603930 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dec94668-5583-427e-9994-c1179363010a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:54.619677 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dec94668-5583-427e-9994-c1179363010a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:54.624622 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dec94668-5583-427e-9994-c1179363010a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:54.629043 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dec94668-5583-427e-9994-c1179363010a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:54.629855 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dec94668-5583-427e-9994-c1179363010a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:54.707994 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-11e5d911-cf87-4e1a-b735-338e4cbe1860 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:54.709265 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-11e5d911-cf87-4e1a-b735-338e4cbe1860 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:54.717119 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11e5d911-cf87-4e1a-b735-338e4cbe1860 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:54.717940 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11e5d911-cf87-4e1a-b735-338e4cbe1860 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:54.718969 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11e5d911-cf87-4e1a-b735-338e4cbe1860 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:54.719596 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11e5d911-cf87-4e1a-b735-338e4cbe1860 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:54.769443 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dec94668-5583-427e-9994-c1179363010a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:54.789051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dec94668-5583-427e-9994-c1179363010a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:54.797940 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dec94668-5583-427e-9994-c1179363010a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:54.801757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dec94668-5583-427e-9994-c1179363010a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1339 microversion: 2.20 time: 0.204839 Jul 31 19:59:54.802098 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-11e5d911-cf87-4e1a-b735-338e4cbe1860 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:54.803618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 15/30] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 19:59:54 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1339 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:59:54.832060 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-11e5d911-cf87-4e1a-b735-338e4cbe1860 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1242 microversion: 2.1 time: 0.125494 Jul 31 19:59:54.835242 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 16/31] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:54 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1242 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:54.894318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5fade0bd-e1ed-4e38-a837-181591386d75 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:54.895223 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5fade0bd-e1ed-4e38-a837-181591386d75 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:54.904518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fade0bd-e1ed-4e38-a837-181591386d75 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:54.906603 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fade0bd-e1ed-4e38-a837-181591386d75 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:54.909928 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fade0bd-e1ed-4e38-a837-181591386d75 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:54.910561 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fade0bd-e1ed-4e38-a837-181591386d75 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:54.990414 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a1ad90e7-a3cc-4cda-a3cf-1ea7a06f7e61 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:54.991204 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a1ad90e7-a3cc-4cda-a3cf-1ea7a06f7e61 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:55.006507 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a1ad90e7-a3cc-4cda-a3cf-1ea7a06f7e61 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:55.007402 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a1ad90e7-a3cc-4cda-a3cf-1ea7a06f7e61 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:55.008396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a1ad90e7-a3cc-4cda-a3cf-1ea7a06f7e61 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:55.009029 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a1ad90e7-a3cc-4cda-a3cf-1ea7a06f7e61 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:55.525893 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5fade0bd-e1ed-4e38-a837-181591386d75 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:55.537958 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5fade0bd-e1ed-4e38-a837-181591386d75 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1245 microversion: 2.1 time: 0.645691 Jul 31 19:59:55.539900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 16/32] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:54 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1245 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:55.574540 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-66a1a2d3-b8a8-45e6-8a0a-3cc5b3f64d40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:55.577332 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-66a1a2d3-b8a8-45e6-8a0a-3cc5b3f64d40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:55.597721 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66a1a2d3-b8a8-45e6-8a0a-3cc5b3f64d40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:55.601403 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66a1a2d3-b8a8-45e6-8a0a-3cc5b3f64d40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:55.602680 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66a1a2d3-b8a8-45e6-8a0a-3cc5b3f64d40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:55.620413 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66a1a2d3-b8a8-45e6-8a0a-3cc5b3f64d40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:55.708171 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a1ad90e7-a3cc-4cda-a3cf-1ea7a06f7e61 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:55.721801 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a1ad90e7-a3cc-4cda-a3cf-1ea7a06f7e61 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1217 microversion: 2.1 time: 0.734755 Jul 31 19:59:55.722380 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 17/33] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:54 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1217 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 19:59:55.830062 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-13030bbe-b694-465c-b61f-ddad63299213 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:55.832955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-13030bbe-b694-465c-b61f-ddad63299213 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:55.852205 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-13030bbe-b694-465c-b61f-ddad63299213 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:55.871821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-13030bbe-b694-465c-b61f-ddad63299213 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:55.875335 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-13030bbe-b694-465c-b61f-ddad63299213 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:55.880714 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-13030bbe-b694-465c-b61f-ddad63299213 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:56.049590 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-66a1a2d3-b8a8-45e6-8a0a-3cc5b3f64d40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:56.077314 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-66a1a2d3-b8a8-45e6-8a0a-3cc5b3f64d40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1266 microversion: 2.1 time: 0.521639 Jul 31 19:59:56.078037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 17/34] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:55 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1266 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:56.098867 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7d3f4da3-6ebc-4db3-a294-1b0cc8c0d63e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:56.111158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7d3f4da3-6ebc-4db3-a294-1b0cc8c0d63e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:56.123965 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d3f4da3-6ebc-4db3-a294-1b0cc8c0d63e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:56.133970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d3f4da3-6ebc-4db3-a294-1b0cc8c0d63e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:56.138236 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d3f4da3-6ebc-4db3-a294-1b0cc8c0d63e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:56.138902 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d3f4da3-6ebc-4db3-a294-1b0cc8c0d63e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:56.348899 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-13030bbe-b694-465c-b61f-ddad63299213 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:56.367543 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-13030bbe-b694-465c-b61f-ddad63299213 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:56.370866 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-13030bbe-b694-465c-b61f-ddad63299213 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:56.376473 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-13030bbe-b694-465c-b61f-ddad63299213 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1337 microversion: 2.20 time: 0.551035 Jul 31 19:59:56.377829 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 18/35] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 19:59:55 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1337 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 19:59:56.400126 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7d3f4da3-6ebc-4db3-a294-1b0cc8c0d63e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:56.411842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7d3f4da3-6ebc-4db3-a294-1b0cc8c0d63e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1290 microversion: 2.1 time: 0.320178 Jul 31 19:59:56.412718 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 18/36] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:56 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1290 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:56.560170 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8db5d367-fe5f-493a-9255-0c752a96e06c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:56.560763 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8db5d367-fe5f-493a-9255-0c752a96e06c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:56.570395 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8db5d367-fe5f-493a-9255-0c752a96e06c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:56.577196 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8db5d367-fe5f-493a-9255-0c752a96e06c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:56.578180 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8db5d367-fe5f-493a-9255-0c752a96e06c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:56.585828 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8db5d367-fe5f-493a-9255-0c752a96e06c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:56.747486 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e6f41eb6-951d-4c3a-be57-d415d4914c37 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:56.748190 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e6f41eb6-951d-4c3a-be57-d415d4914c37 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:56.764766 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e6f41eb6-951d-4c3a-be57-d415d4914c37 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:56.766912 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e6f41eb6-951d-4c3a-be57-d415d4914c37 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:56.767798 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e6f41eb6-951d-4c3a-be57-d415d4914c37 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:56.773966 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e6f41eb6-951d-4c3a-be57-d415d4914c37 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:57.193482 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8db5d367-fe5f-493a-9255-0c752a96e06c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:57.211997 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8db5d367-fe5f-493a-9255-0c752a96e06c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1293 microversion: 2.1 time: 0.655481 Jul 31 19:59:57.224139 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e6f41eb6-951d-4c3a-be57-d415d4914c37 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:57.248669 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 19/37] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:56 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1293 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:57.248990 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e6f41eb6-951d-4c3a-be57-d415d4914c37 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1273 microversion: 2.1 time: 0.496220 Jul 31 19:59:57.248990 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 19/38] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:56 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1273 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 19:59:57.253230 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fc39362a-2980-4628-ae84-12cbe8a80167 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:57.255507 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fc39362a-2980-4628-ae84-12cbe8a80167 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:57.277007 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:59:57.282405 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc39362a-2980-4628-ae84-12cbe8a80167 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:57.283361 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc39362a-2980-4628-ae84-12cbe8a80167 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:57.284350 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc39362a-2980-4628-ae84-12cbe8a80167 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:57.291850 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc39362a-2980-4628-ae84-12cbe8a80167 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:57.416572 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4ea149f5-a40d-4ed8-9808-e831936d4312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:57.418375 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4ea149f5-a40d-4ed8-9808-e831936d4312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:57.440888 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ea149f5-a40d-4ed8-9808-e831936d4312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:57.442181 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ea149f5-a40d-4ed8-9808-e831936d4312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:57.444371 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ea149f5-a40d-4ed8-9808-e831936d4312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:57.445276 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ea149f5-a40d-4ed8-9808-e831936d4312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:57.634994 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fc39362a-2980-4628-ae84-12cbe8a80167 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:57.647549 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fc39362a-2980-4628-ae84-12cbe8a80167 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1274 microversion: 2.1 time: 0.407355 Jul 31 19:59:57.648378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 20/39] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:57 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1274 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:57.664588 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3dcaf4f3-0130-4b0e-bffa-72cef21620cd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:57.666205 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3dcaf4f3-0130-4b0e-bffa-72cef21620cd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:57.674575 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3dcaf4f3-0130-4b0e-bffa-72cef21620cd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:57.675743 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3dcaf4f3-0130-4b0e-bffa-72cef21620cd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:57.677667 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3dcaf4f3-0130-4b0e-bffa-72cef21620cd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:57.681217 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3dcaf4f3-0130-4b0e-bffa-72cef21620cd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:57.893313 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3dcaf4f3-0130-4b0e-bffa-72cef21620cd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:57.901983 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3dcaf4f3-0130-4b0e-bffa-72cef21620cd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1290 microversion: 2.1 time: 0.252353 Jul 31 19:59:57.903462 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 21/40] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:57 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1290 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:57.951573 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4ea149f5-a40d-4ed8-9808-e831936d4312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:57.960163 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4ea149f5-a40d-4ed8-9808-e831936d4312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:57.961720 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4ea149f5-a40d-4ed8-9808-e831936d4312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:57.962844 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4ea149f5-a40d-4ed8-9808-e831936d4312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.566164 Jul 31 19:59:57.963396 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 19:59:57 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:59:58.256124 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-73a709e1-f8d6-4735-94ec-6b584f7e75a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:58.256773 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-73a709e1-f8d6-4735-94ec-6b584f7e75a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:58.265736 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-73a709e1-f8d6-4735-94ec-6b584f7e75a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:58.266154 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-04d6959f-ca25-4942-9ddb-84efbf7dfcee tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:58.266281 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-73a709e1-f8d6-4735-94ec-6b584f7e75a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:58.266773 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-04d6959f-ca25-4942-9ddb-84efbf7dfcee tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:58.267176 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-73a709e1-f8d6-4735-94ec-6b584f7e75a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:58.267677 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-73a709e1-f8d6-4735-94ec-6b584f7e75a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:58.272957 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04d6959f-ca25-4942-9ddb-84efbf7dfcee tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:58.273442 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04d6959f-ca25-4942-9ddb-84efbf7dfcee tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:58.274320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04d6959f-ca25-4942-9ddb-84efbf7dfcee tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:58.274778 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04d6959f-ca25-4942-9ddb-84efbf7dfcee tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:58.355853 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-73a709e1-f8d6-4735-94ec-6b584f7e75a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:58.358459 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-04d6959f-ca25-4942-9ddb-84efbf7dfcee tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:58.363657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-73a709e1-f8d6-4735-94ec-6b584f7e75a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1293 microversion: 2.1 time: 0.111417 Jul 31 19:59:58.365184 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 22/42] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:58 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1293 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:58.367157 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-04d6959f-ca25-4942-9ddb-84efbf7dfcee tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1273 microversion: 2.1 time: 0.107086 Jul 31 19:59:58.380688 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 21/43] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:58 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:58.675575 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4dcfcfae-607e-4ebb-adbb-0415bdc84e71 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:58.676198 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4dcfcfae-607e-4ebb-adbb-0415bdc84e71 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:58.682592 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4dcfcfae-607e-4ebb-adbb-0415bdc84e71 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:58.683266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4dcfcfae-607e-4ebb-adbb-0415bdc84e71 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:58.683992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4dcfcfae-607e-4ebb-adbb-0415bdc84e71 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:58.684610 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4dcfcfae-607e-4ebb-adbb-0415bdc84e71 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:58.747166 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4dcfcfae-607e-4ebb-adbb-0415bdc84e71 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:58.756227 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4dcfcfae-607e-4ebb-adbb-0415bdc84e71 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1274 microversion: 2.1 time: 0.084560 Jul 31 19:59:58.756801 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 23/44] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:58 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:58.925190 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1f814190-5824-453b-8c97-64a9f6ca5db0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:58.925745 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1f814190-5824-453b-8c97-64a9f6ca5db0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:58.932063 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f814190-5824-453b-8c97-64a9f6ca5db0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:58.932520 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f814190-5824-453b-8c97-64a9f6ca5db0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:58.933316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f814190-5824-453b-8c97-64a9f6ca5db0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:58.933752 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f814190-5824-453b-8c97-64a9f6ca5db0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:58.985535 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-68058071-1c8c-4081-886b-0375e7cdf4ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:58.986163 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-68058071-1c8c-4081-886b-0375e7cdf4ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:58.992509 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68058071-1c8c-4081-886b-0375e7cdf4ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:58.992917 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68058071-1c8c-4081-886b-0375e7cdf4ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:58.994100 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68058071-1c8c-4081-886b-0375e7cdf4ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:58.994522 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68058071-1c8c-4081-886b-0375e7cdf4ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:58.995493 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1f814190-5824-453b-8c97-64a9f6ca5db0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:59.003379 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1f814190-5824-453b-8c97-64a9f6ca5db0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1290 microversion: 2.1 time: 0.082217 Jul 31 19:59:59.004166 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 22/45] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:58 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 19:59:59.140554 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-68058071-1c8c-4081-886b-0375e7cdf4ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:59.149559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-68058071-1c8c-4081-886b-0375e7cdf4ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:59.151122 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-68058071-1c8c-4081-886b-0375e7cdf4ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:59.152290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-68058071-1c8c-4081-886b-0375e7cdf4ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.170706 Jul 31 19:59:59.152806 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 19:59:58 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 19:59:59.386934 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-12343349-0778-4909-9d57-20d6ff45fc34 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:59.387600 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-12343349-0778-4909-9d57-20d6ff45fc34 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:59.393295 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-15c6980a-4d9d-4cff-aa5b-cd1a9f7d69ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:59.397908 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-15c6980a-4d9d-4cff-aa5b-cd1a9f7d69ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:59.402861 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:59:59.414700 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-15c6980a-4d9d-4cff-aa5b-cd1a9f7d69ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:59.416538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-15c6980a-4d9d-4cff-aa5b-cd1a9f7d69ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:59.417115 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12343349-0778-4909-9d57-20d6ff45fc34 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:59.417703 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12343349-0778-4909-9d57-20d6ff45fc34 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:59.418554 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-15c6980a-4d9d-4cff-aa5b-cd1a9f7d69ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:59.418661 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12343349-0778-4909-9d57-20d6ff45fc34 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:59.419126 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12343349-0778-4909-9d57-20d6ff45fc34 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:59.419452 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-15c6980a-4d9d-4cff-aa5b-cd1a9f7d69ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:59.667405 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-15c6980a-4d9d-4cff-aa5b-cd1a9f7d69ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:59.668955 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-12343349-0778-4909-9d57-20d6ff45fc34 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:59.677679 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-15c6980a-4d9d-4cff-aa5b-cd1a9f7d69ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1273 microversion: 2.1 time: 0.291593 Jul 31 19:59:59.679198 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-12343349-0778-4909-9d57-20d6ff45fc34 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1293 microversion: 2.1 time: 0.296978 Jul 31 19:59:59.680090 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 25/47] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:59 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1273 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:59.705590 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 23/48] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:59 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1293 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 19:59:59.788778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d5f9d756-c45a-4cca-a0af-ada094b2c965 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 19:59:59.789822 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d5f9d756-c45a-4cca-a0af-ada094b2c965 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 19:59:59.798747 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5f9d756-c45a-4cca-a0af-ada094b2c965 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:59.799715 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5f9d756-c45a-4cca-a0af-ada094b2c965 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:59.800722 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5f9d756-c45a-4cca-a0af-ada094b2c965 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 19:59:59.802544 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5f9d756-c45a-4cca-a0af-ada094b2c965 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 19:59:59.826747 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 19:59:59.896638 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d5f9d756-c45a-4cca-a0af-ada094b2c965 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 19:59:59.908835 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d5f9d756-c45a-4cca-a0af-ada094b2c965 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1274 microversion: 2.1 time: 0.131303 Jul 31 19:59:59.923692 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 26/49] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 19:59:59 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:00.024077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0cdbbb03-e24b-4cd9-972d-49b6674f3ed2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:00.024720 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0cdbbb03-e24b-4cd9-972d-49b6674f3ed2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:00.049980 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cdbbb03-e24b-4cd9-972d-49b6674f3ed2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:00.051514 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cdbbb03-e24b-4cd9-972d-49b6674f3ed2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:00.054289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cdbbb03-e24b-4cd9-972d-49b6674f3ed2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:00.054798 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cdbbb03-e24b-4cd9-972d-49b6674f3ed2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:00.082971 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:00.157685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0cdbbb03-e24b-4cd9-972d-49b6674f3ed2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:00.166782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0cdbbb03-e24b-4cd9-972d-49b6674f3ed2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1298 microversion: 2.1 time: 0.146565 Jul 31 20:00:00.177259 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 24/50] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:00 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:00.183376 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a446fc8a-a311-4c18-a11c-789fce389509 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:00.183980 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a446fc8a-a311-4c18-a11c-789fce389509 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:00.190744 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a446fc8a-a311-4c18-a11c-789fce389509 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:00.191186 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a446fc8a-a311-4c18-a11c-789fce389509 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:00.191933 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a446fc8a-a311-4c18-a11c-789fce389509 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:00.192352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a446fc8a-a311-4c18-a11c-789fce389509 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:00.347297 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a446fc8a-a311-4c18-a11c-789fce389509 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:00.355489 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a446fc8a-a311-4c18-a11c-789fce389509 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:00.356993 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a446fc8a-a311-4c18-a11c-789fce389509 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:00.358228 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a446fc8a-a311-4c18-a11c-789fce389509 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.179372 Jul 31 20:00:00.368173 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 27/51] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:00 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:00.702899 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-24dd3eed-b619-45aa-a685-ec11dffca3fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:00.710842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-24dd3eed-b619-45aa-a685-ec11dffca3fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:00.713093 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6b861b27-2082-4392-ae92-06315e1014d5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:00.714134 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6b861b27-2082-4392-ae92-06315e1014d5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:00.718787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24dd3eed-b619-45aa-a685-ec11dffca3fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:00.719482 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24dd3eed-b619-45aa-a685-ec11dffca3fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:00.720497 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24dd3eed-b619-45aa-a685-ec11dffca3fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:00.720924 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24dd3eed-b619-45aa-a685-ec11dffca3fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:00.721052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b861b27-2082-4392-ae92-06315e1014d5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:00.721510 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b861b27-2082-4392-ae92-06315e1014d5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:00.722280 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b861b27-2082-4392-ae92-06315e1014d5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:00.722708 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b861b27-2082-4392-ae92-06315e1014d5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:00.813548 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-24dd3eed-b619-45aa-a685-ec11dffca3fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:00.821097 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-24dd3eed-b619-45aa-a685-ec11dffca3fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1273 microversion: 2.1 time: 0.125057 Jul 31 20:00:00.821700 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 25/52] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:00 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:00.828443 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6b861b27-2082-4392-ae92-06315e1014d5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:00.836064 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6b861b27-2082-4392-ae92-06315e1014d5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1293 microversion: 2.1 time: 0.138174 Jul 31 20:00:00.836629 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 28/53] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:00 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1293 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:00.926775 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0d5291b0-5d04-48e4-a3ab-4f2659f28caa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:00.927525 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0d5291b0-5d04-48e4-a3ab-4f2659f28caa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:00.933990 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d5291b0-5d04-48e4-a3ab-4f2659f28caa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:00.934424 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d5291b0-5d04-48e4-a3ab-4f2659f28caa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:00.935182 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d5291b0-5d04-48e4-a3ab-4f2659f28caa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:00.935606 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d5291b0-5d04-48e4-a3ab-4f2659f28caa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:00.999545 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0d5291b0-5d04-48e4-a3ab-4f2659f28caa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:01.007153 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0d5291b0-5d04-48e4-a3ab-4f2659f28caa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1274 microversion: 2.1 time: 0.084537 Jul 31 20:00:01.007687 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 26/54] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:00 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:01.193933 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7ba4de93-3065-46f5-ae49-f92fc78a3223 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:01.194803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7ba4de93-3065-46f5-ae49-f92fc78a3223 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:01.201042 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7ba4de93-3065-46f5-ae49-f92fc78a3223 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:01.201546 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7ba4de93-3065-46f5-ae49-f92fc78a3223 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:01.202352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7ba4de93-3065-46f5-ae49-f92fc78a3223 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:01.202780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7ba4de93-3065-46f5-ae49-f92fc78a3223 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:01.267461 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7ba4de93-3065-46f5-ae49-f92fc78a3223 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:01.277305 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7ba4de93-3065-46f5-ae49-f92fc78a3223 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1298 microversion: 2.1 time: 0.086844 Jul 31 20:00:01.278527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 29/55] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:01 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:01.383191 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9bb8c3d8-a5c8-4ffe-b052-65b58a51b488 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:01.383747 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9bb8c3d8-a5c8-4ffe-b052-65b58a51b488 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:01.390404 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bb8c3d8-a5c8-4ffe-b052-65b58a51b488 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:01.390856 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bb8c3d8-a5c8-4ffe-b052-65b58a51b488 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:01.391622 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bb8c3d8-a5c8-4ffe-b052-65b58a51b488 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:01.392056 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bb8c3d8-a5c8-4ffe-b052-65b58a51b488 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:01.550357 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9bb8c3d8-a5c8-4ffe-b052-65b58a51b488 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:01.559278 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9bb8c3d8-a5c8-4ffe-b052-65b58a51b488 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:01.561014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9bb8c3d8-a5c8-4ffe-b052-65b58a51b488 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:01.562182 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9bb8c3d8-a5c8-4ffe-b052-65b58a51b488 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.183123 Jul 31 20:00:01.562726 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 27/56] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:01 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:01.844109 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bbe4f865-7d17-468d-bea1-0f0d32f0e300 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:01.844776 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bbe4f865-7d17-468d-bea1-0f0d32f0e300 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:01.851686 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bbe4f865-7d17-468d-bea1-0f0d32f0e300 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:01.852133 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bbe4f865-7d17-468d-bea1-0f0d32f0e300 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:01.853023 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bbe4f865-7d17-468d-bea1-0f0d32f0e300 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:01.853476 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bbe4f865-7d17-468d-bea1-0f0d32f0e300 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:01.856904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-399c8ab2-2fbb-4c5f-959c-23851144c758 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:01.858993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-399c8ab2-2fbb-4c5f-959c-23851144c758 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:01.864703 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-399c8ab2-2fbb-4c5f-959c-23851144c758 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:01.865144 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-399c8ab2-2fbb-4c5f-959c-23851144c758 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:01.865951 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-399c8ab2-2fbb-4c5f-959c-23851144c758 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:01.866516 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-399c8ab2-2fbb-4c5f-959c-23851144c758 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:01.925142 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bbe4f865-7d17-468d-bea1-0f0d32f0e300 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:01.932714 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bbe4f865-7d17-468d-bea1-0f0d32f0e300 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1273 microversion: 2.1 time: 0.092717 Jul 31 20:00:01.933310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 30/57] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:01 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:01.944066 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-399c8ab2-2fbb-4c5f-959c-23851144c758 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:01.954478 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-399c8ab2-2fbb-4c5f-959c-23851144c758 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1293 microversion: 2.1 time: 0.102194 Jul 31 20:00:01.955231 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 28/58] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:01 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1293 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:02.028234 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-db73e32f-f923-46a1-afe1-baf168b02343 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:02.028849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-db73e32f-f923-46a1-afe1-baf168b02343 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:02.035241 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db73e32f-f923-46a1-afe1-baf168b02343 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:02.035689 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db73e32f-f923-46a1-afe1-baf168b02343 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:02.036449 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db73e32f-f923-46a1-afe1-baf168b02343 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:02.036890 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db73e32f-f923-46a1-afe1-baf168b02343 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:02.123556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-db73e32f-f923-46a1-afe1-baf168b02343 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:02.131278 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-db73e32f-f923-46a1-afe1-baf168b02343 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1274 microversion: 2.1 time: 0.106982 Jul 31 20:00:02.131859 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 31/59] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:02 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:02.298093 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b7f6e385-7a08-4db3-beaa-faf2c3acc311 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:02.298612 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b7f6e385-7a08-4db3-beaa-faf2c3acc311 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:02.300492 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:02.306286 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b7f6e385-7a08-4db3-beaa-faf2c3acc311 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:02.306736 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b7f6e385-7a08-4db3-beaa-faf2c3acc311 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:02.307517 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b7f6e385-7a08-4db3-beaa-faf2c3acc311 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:02.307951 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b7f6e385-7a08-4db3-beaa-faf2c3acc311 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:02.368281 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b7f6e385-7a08-4db3-beaa-faf2c3acc311 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:02.376465 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b7f6e385-7a08-4db3-beaa-faf2c3acc311 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1298 microversion: 2.1 time: 0.082574 Jul 31 20:00:02.377044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 29/60] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:02 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:02.584473 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-39a4539f-5259-4664-8890-3da52a4a081c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:02.585081 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-39a4539f-5259-4664-8890-3da52a4a081c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:02.591904 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39a4539f-5259-4664-8890-3da52a4a081c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:02.592304 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39a4539f-5259-4664-8890-3da52a4a081c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:02.593435 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39a4539f-5259-4664-8890-3da52a4a081c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:02.593574 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39a4539f-5259-4664-8890-3da52a4a081c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:02.634587 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:02.734200 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-39a4539f-5259-4664-8890-3da52a4a081c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:02.744070 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-39a4539f-5259-4664-8890-3da52a4a081c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:02.745712 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-39a4539f-5259-4664-8890-3da52a4a081c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:02.747171 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-39a4539f-5259-4664-8890-3da52a4a081c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.166610 Jul 31 20:00:02.747866 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 32/61] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:02 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:02.954547 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bf43ca87-87f7-448e-b4a3-5b1b38383de6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:02.955781 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bf43ca87-87f7-448e-b4a3-5b1b38383de6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:02.957881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=24 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:02.967842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf43ca87-87f7-448e-b4a3-5b1b38383de6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:02.968548 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf43ca87-87f7-448e-b4a3-5b1b38383de6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:02.969264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf43ca87-87f7-448e-b4a3-5b1b38383de6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:02.969835 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf43ca87-87f7-448e-b4a3-5b1b38383de6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:02.980929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-eb15e197-934f-4ca6-b3d6-0dd09b1fb457 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:02.981716 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-eb15e197-934f-4ca6-b3d6-0dd09b1fb457 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:02.983979 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=30 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:02.991590 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb15e197-934f-4ca6-b3d6-0dd09b1fb457 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:02.992396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb15e197-934f-4ca6-b3d6-0dd09b1fb457 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:02.993384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb15e197-934f-4ca6-b3d6-0dd09b1fb457 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:02.994246 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb15e197-934f-4ca6-b3d6-0dd09b1fb457 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:03.043719 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bf43ca87-87f7-448e-b4a3-5b1b38383de6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:03.052103 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bf43ca87-87f7-448e-b4a3-5b1b38383de6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1273 microversion: 2.1 time: 0.101987 Jul 31 20:00:03.052821 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 30/62] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:02 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:03.073264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-eb15e197-934f-4ca6-b3d6-0dd09b1fb457 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:03.082129 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-eb15e197-934f-4ca6-b3d6-0dd09b1fb457 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1293 microversion: 2.1 time: 0.105201 Jul 31 20:00:03.082698 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 33/63] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:02 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:03.152886 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-df0b7be7-c744-42ae-95d9-7694e3ddaeaf tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:03.153546 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-df0b7be7-c744-42ae-95d9-7694e3ddaeaf tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:03.160079 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df0b7be7-c744-42ae-95d9-7694e3ddaeaf tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:03.160520 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df0b7be7-c744-42ae-95d9-7694e3ddaeaf tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:03.161386 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df0b7be7-c744-42ae-95d9-7694e3ddaeaf tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:03.161839 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df0b7be7-c744-42ae-95d9-7694e3ddaeaf tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:03.227211 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-df0b7be7-c744-42ae-95d9-7694e3ddaeaf tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:03.235413 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-df0b7be7-c744-42ae-95d9-7694e3ddaeaf tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1274 microversion: 2.1 time: 0.086601 Jul 31 20:00:03.236000 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 31/64] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:03 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:03.409382 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2fcf823f-eb0e-4df3-91c8-86af4aae15b2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:03.410342 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2fcf823f-eb0e-4df3-91c8-86af4aae15b2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:03.418495 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2fcf823f-eb0e-4df3-91c8-86af4aae15b2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:03.418913 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2fcf823f-eb0e-4df3-91c8-86af4aae15b2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:03.419687 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2fcf823f-eb0e-4df3-91c8-86af4aae15b2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:03.420128 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2fcf823f-eb0e-4df3-91c8-86af4aae15b2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:03.480960 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2fcf823f-eb0e-4df3-91c8-86af4aae15b2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:03.489623 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2fcf823f-eb0e-4df3-91c8-86af4aae15b2 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1298 microversion: 2.1 time: 0.090824 Jul 31 20:00:03.490270 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 34/65] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:03 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:03.771537 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-abee36b7-3211-40fb-a25f-dad7f25da34b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:03.772133 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-abee36b7-3211-40fb-a25f-dad7f25da34b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:03.780653 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abee36b7-3211-40fb-a25f-dad7f25da34b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:03.781091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abee36b7-3211-40fb-a25f-dad7f25da34b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:03.781875 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abee36b7-3211-40fb-a25f-dad7f25da34b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:03.782299 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abee36b7-3211-40fb-a25f-dad7f25da34b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:03.981394 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-abee36b7-3211-40fb-a25f-dad7f25da34b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:03.989512 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-abee36b7-3211-40fb-a25f-dad7f25da34b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:03.990997 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-abee36b7-3211-40fb-a25f-dad7f25da34b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:03.992077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-abee36b7-3211-40fb-a25f-dad7f25da34b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.225289 Jul 31 20:00:03.992625 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 32/66] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:03 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:04.073678 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c614705c-0bb1-4aaf-8629-f71d90afd0f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:04.075032 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c614705c-0bb1-4aaf-8629-f71d90afd0f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:04.082111 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c614705c-0bb1-4aaf-8629-f71d90afd0f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:04.082477 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c614705c-0bb1-4aaf-8629-f71d90afd0f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:04.083256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c614705c-0bb1-4aaf-8629-f71d90afd0f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:04.083689 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c614705c-0bb1-4aaf-8629-f71d90afd0f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:04.103163 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b80204dd-7628-4617-b385-acdf5aa283bb tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:04.103761 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b80204dd-7628-4617-b385-acdf5aa283bb tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:04.115612 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b80204dd-7628-4617-b385-acdf5aa283bb tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:04.116801 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b80204dd-7628-4617-b385-acdf5aa283bb tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:04.129800 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b80204dd-7628-4617-b385-acdf5aa283bb tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:04.130688 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b80204dd-7628-4617-b385-acdf5aa283bb tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:04.157336 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c614705c-0bb1-4aaf-8629-f71d90afd0f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:04.165022 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c614705c-0bb1-4aaf-8629-f71d90afd0f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1273 microversion: 2.1 time: 0.095227 Jul 31 20:00:04.165647 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 35/67] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:04 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:04.203055 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b80204dd-7628-4617-b385-acdf5aa283bb tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:04.211139 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b80204dd-7628-4617-b385-acdf5aa283bb tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1293 microversion: 2.1 time: 0.112202 Jul 31 20:00:04.221264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 33/68] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:04 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:04.256340 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4ec496be-9333-43bb-b025-436249882338 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:04.256998 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4ec496be-9333-43bb-b025-436249882338 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:04.263353 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4ec496be-9333-43bb-b025-436249882338 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:04.263787 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4ec496be-9333-43bb-b025-436249882338 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:04.264619 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4ec496be-9333-43bb-b025-436249882338 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:04.265076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4ec496be-9333-43bb-b025-436249882338 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:04.325709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4ec496be-9333-43bb-b025-436249882338 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:04.334578 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4ec496be-9333-43bb-b025-436249882338 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1274 microversion: 2.1 time: 0.082027 Jul 31 20:00:04.340297 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 36/69] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:04 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:04.512845 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1420731c-5764-4e56-b3d9-bdf1e69e7530 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:04.513613 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1420731c-5764-4e56-b3d9-bdf1e69e7530 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:04.519949 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1420731c-5764-4e56-b3d9-bdf1e69e7530 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:04.520387 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1420731c-5764-4e56-b3d9-bdf1e69e7530 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:04.521178 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1420731c-5764-4e56-b3d9-bdf1e69e7530 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:04.521638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1420731c-5764-4e56-b3d9-bdf1e69e7530 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:04.591663 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1420731c-5764-4e56-b3d9-bdf1e69e7530 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:04.599497 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1420731c-5764-4e56-b3d9-bdf1e69e7530 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1298 microversion: 2.1 time: 0.090550 Jul 31 20:00:04.600834 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 34/70] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:04 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:05.015853 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d3e18c65-d91a-422c-bf27-00a3c8ba5a9a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:05.016554 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d3e18c65-d91a-422c-bf27-00a3c8ba5a9a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:05.023120 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d3e18c65-d91a-422c-bf27-00a3c8ba5a9a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:05.023539 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d3e18c65-d91a-422c-bf27-00a3c8ba5a9a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:05.024300 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d3e18c65-d91a-422c-bf27-00a3c8ba5a9a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:05.024787 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d3e18c65-d91a-422c-bf27-00a3c8ba5a9a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:05.168874 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d3e18c65-d91a-422c-bf27-00a3c8ba5a9a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:05.179262 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d3e18c65-d91a-422c-bf27-00a3c8ba5a9a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:05.189173 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d3e18c65-d91a-422c-bf27-00a3c8ba5a9a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:05.190582 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d3e18c65-d91a-422c-bf27-00a3c8ba5a9a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.178689 Jul 31 20:00:05.191632 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 37/71] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:05 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:05.192644 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e462077e-50dc-4222-97db-f35413da9de9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:05.193383 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e462077e-50dc-4222-97db-f35413da9de9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:05.200338 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e462077e-50dc-4222-97db-f35413da9de9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:05.201025 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e462077e-50dc-4222-97db-f35413da9de9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:05.201978 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e462077e-50dc-4222-97db-f35413da9de9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:05.202757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e462077e-50dc-4222-97db-f35413da9de9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:05.232577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2b4bcffe-dee3-4d5c-b3e3-e6aecd7c47f0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:05.233227 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2b4bcffe-dee3-4d5c-b3e3-e6aecd7c47f0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:05.239616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2b4bcffe-dee3-4d5c-b3e3-e6aecd7c47f0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:05.240086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2b4bcffe-dee3-4d5c-b3e3-e6aecd7c47f0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:05.240838 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2b4bcffe-dee3-4d5c-b3e3-e6aecd7c47f0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:05.241365 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2b4bcffe-dee3-4d5c-b3e3-e6aecd7c47f0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:05.267539 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e462077e-50dc-4222-97db-f35413da9de9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:05.275043 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e462077e-50dc-4222-97db-f35413da9de9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1273 microversion: 2.1 time: 0.090729 Jul 31 20:00:05.275799 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 35/72] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:05 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:05.307641 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2b4bcffe-dee3-4d5c-b3e3-e6aecd7c47f0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:05.316567 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2b4bcffe-dee3-4d5c-b3e3-e6aecd7c47f0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1293 microversion: 2.1 time: 0.087797 Jul 31 20:00:05.328356 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 38/73] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:05 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:05.357073 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4397140f-e7a6-4f2c-ae5e-869dc8d5f4f5 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:05.357734 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4397140f-e7a6-4f2c-ae5e-869dc8d5f4f5 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:05.364070 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4397140f-e7a6-4f2c-ae5e-869dc8d5f4f5 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:05.364503 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4397140f-e7a6-4f2c-ae5e-869dc8d5f4f5 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:05.365290 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4397140f-e7a6-4f2c-ae5e-869dc8d5f4f5 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:05.365713 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4397140f-e7a6-4f2c-ae5e-869dc8d5f4f5 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:05.429990 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4397140f-e7a6-4f2c-ae5e-869dc8d5f4f5 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:05.438152 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4397140f-e7a6-4f2c-ae5e-869dc8d5f4f5 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1274 microversion: 2.1 time: 0.084771 Jul 31 20:00:05.438766 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 36/74] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:05 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:05.620643 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6cc4c075-aa9b-4bf9-aa6c-4adda27cba27 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:05.621273 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6cc4c075-aa9b-4bf9-aa6c-4adda27cba27 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:05.628239 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6cc4c075-aa9b-4bf9-aa6c-4adda27cba27 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:05.628674 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6cc4c075-aa9b-4bf9-aa6c-4adda27cba27 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:05.629468 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6cc4c075-aa9b-4bf9-aa6c-4adda27cba27 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:05.629872 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6cc4c075-aa9b-4bf9-aa6c-4adda27cba27 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:05.705332 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6cc4c075-aa9b-4bf9-aa6c-4adda27cba27 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:05.718442 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6cc4c075-aa9b-4bf9-aa6c-4adda27cba27 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1298 microversion: 2.1 time: 0.101731 Jul 31 20:00:05.719403 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 39/75] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:05 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:06.213766 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8fb2247-3114-4247-92b3-a9f8d57a955a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:06.214298 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f8fb2247-3114-4247-92b3-a9f8d57a955a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:06.220739 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8fb2247-3114-4247-92b3-a9f8d57a955a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:06.221061 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8fb2247-3114-4247-92b3-a9f8d57a955a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:06.221849 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8fb2247-3114-4247-92b3-a9f8d57a955a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:06.222299 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8fb2247-3114-4247-92b3-a9f8d57a955a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:06.297689 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-771fb602-7535-4ca0-b169-fc92e4d2a9b3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:06.298449 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-771fb602-7535-4ca0-b169-fc92e4d2a9b3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:06.305911 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-771fb602-7535-4ca0-b169-fc92e4d2a9b3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:06.306650 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-771fb602-7535-4ca0-b169-fc92e4d2a9b3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:06.307959 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-771fb602-7535-4ca0-b169-fc92e4d2a9b3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:06.308527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-771fb602-7535-4ca0-b169-fc92e4d2a9b3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:06.414231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-771fb602-7535-4ca0-b169-fc92e4d2a9b3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:06.430850 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-771fb602-7535-4ca0-b169-fc92e4d2a9b3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1273 microversion: 2.1 time: 0.137391 Jul 31 20:00:06.444475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 40/76] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:06 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:06.444475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-756d7db3-0271-4c7f-955c-23fc3c338ada tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:06.444475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-756d7db3-0271-4c7f-955c-23fc3c338ada tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:06.448380 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-756d7db3-0271-4c7f-955c-23fc3c338ada tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:06.448904 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-756d7db3-0271-4c7f-955c-23fc3c338ada tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:06.449952 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-756d7db3-0271-4c7f-955c-23fc3c338ada tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:06.450446 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-756d7db3-0271-4c7f-955c-23fc3c338ada tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:06.453988 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8fb2247-3114-4247-92b3-a9f8d57a955a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:06.463232 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8fb2247-3114-4247-92b3-a9f8d57a955a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:06.465296 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8fb2247-3114-4247-92b3-a9f8d57a955a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:06.466416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f8fb2247-3114-4247-92b3-a9f8d57a955a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.256751 Jul 31 20:00:06.467067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 37/77] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:06 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:06.471541 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4defab6b-c9c1-445c-abfd-194afbfe363d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:06.472498 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4defab6b-c9c1-445c-abfd-194afbfe363d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:06.486312 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4defab6b-c9c1-445c-abfd-194afbfe363d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:06.487108 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4defab6b-c9c1-445c-abfd-194afbfe363d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:06.487980 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4defab6b-c9c1-445c-abfd-194afbfe363d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:06.488491 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4defab6b-c9c1-445c-abfd-194afbfe363d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:06.516761 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-756d7db3-0271-4c7f-955c-23fc3c338ada tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:06.525235 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-756d7db3-0271-4c7f-955c-23fc3c338ada tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1293 microversion: 2.1 time: 0.092145 Jul 31 20:00:06.526160 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 41/78] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:06 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:06.565698 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4defab6b-c9c1-445c-abfd-194afbfe363d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:06.573602 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4defab6b-c9c1-445c-abfd-194afbfe363d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1274 microversion: 2.1 time: 0.105439 Jul 31 20:00:06.574176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 38/79] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:06 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:06.740907 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cc53b899-b2d4-44a5-a9e9-c710ffb1e65c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:06.741455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cc53b899-b2d4-44a5-a9e9-c710ffb1e65c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:06.748357 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc53b899-b2d4-44a5-a9e9-c710ffb1e65c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:06.748797 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc53b899-b2d4-44a5-a9e9-c710ffb1e65c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:06.749592 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc53b899-b2d4-44a5-a9e9-c710ffb1e65c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:06.750016 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc53b899-b2d4-44a5-a9e9-c710ffb1e65c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:06.814216 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cc53b899-b2d4-44a5-a9e9-c710ffb1e65c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:06.821975 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cc53b899-b2d4-44a5-a9e9-c710ffb1e65c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1298 microversion: 2.1 time: 0.085115 Jul 31 20:00:06.822529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 42/80] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:06 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:07.452789 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-efc42917-bd71-495a-92ff-b19e48693e10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:07.453421 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-efc42917-bd71-495a-92ff-b19e48693e10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:07.460098 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efc42917-bd71-495a-92ff-b19e48693e10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:07.460543 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efc42917-bd71-495a-92ff-b19e48693e10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:07.461339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efc42917-bd71-495a-92ff-b19e48693e10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:07.461767 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efc42917-bd71-495a-92ff-b19e48693e10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:07.488010 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6fab7857-91e8-4c2a-a5ac-0986e6c3c816 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:07.488564 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6fab7857-91e8-4c2a-a5ac-0986e6c3c816 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:07.495612 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6fab7857-91e8-4c2a-a5ac-0986e6c3c816 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:07.496050 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6fab7857-91e8-4c2a-a5ac-0986e6c3c816 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:07.496811 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6fab7857-91e8-4c2a-a5ac-0986e6c3c816 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:07.497272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6fab7857-91e8-4c2a-a5ac-0986e6c3c816 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:07.501345 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:07.526191 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-efc42917-bd71-495a-92ff-b19e48693e10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:07.533934 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-efc42917-bd71-495a-92ff-b19e48693e10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1273 microversion: 2.1 time: 0.085031 Jul 31 20:00:07.534505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 39/81] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:07 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:07.548025 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8431c574-fd32-45e9-a3e8-964381c3af3c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:07.548636 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8431c574-fd32-45e9-a3e8-964381c3af3c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:07.555139 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8431c574-fd32-45e9-a3e8-964381c3af3c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:07.555548 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8431c574-fd32-45e9-a3e8-964381c3af3c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:07.556535 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8431c574-fd32-45e9-a3e8-964381c3af3c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:07.556956 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8431c574-fd32-45e9-a3e8-964381c3af3c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:07.624307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8431c574-fd32-45e9-a3e8-964381c3af3c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:07.632062 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8431c574-fd32-45e9-a3e8-964381c3af3c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1293 microversion: 2.1 time: 0.088070 Jul 31 20:00:07.632636 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 40/82] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:07 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:07.647191 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f4d8f277-fd34-4a84-91b5-8e3fdece5afd tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:07.647911 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f4d8f277-fd34-4a84-91b5-8e3fdece5afd tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:07.650776 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6fab7857-91e8-4c2a-a5ac-0986e6c3c816 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:07.654117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f4d8f277-fd34-4a84-91b5-8e3fdece5afd tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:07.654531 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f4d8f277-fd34-4a84-91b5-8e3fdece5afd tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:07.655292 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f4d8f277-fd34-4a84-91b5-8e3fdece5afd tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:07.655716 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f4d8f277-fd34-4a84-91b5-8e3fdece5afd tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:07.659296 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6fab7857-91e8-4c2a-a5ac-0986e6c3c816 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:07.660041 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:07.660833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6fab7857-91e8-4c2a-a5ac-0986e6c3c816 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:07.661899 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6fab7857-91e8-4c2a-a5ac-0986e6c3c816 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.177875 Jul 31 20:00:07.662449 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 43/83] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:07 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:07.716224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f4d8f277-fd34-4a84-91b5-8e3fdece5afd tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:07.723741 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f4d8f277-fd34-4a84-91b5-8e3fdece5afd tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1274 microversion: 2.1 time: 0.086673 Jul 31 20:00:07.724310 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 41/84] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:07 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:07.845003 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ffddeea3-b7f9-438f-a27a-96a290857ed1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:07.845544 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ffddeea3-b7f9-438f-a27a-96a290857ed1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:07.852125 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ffddeea3-b7f9-438f-a27a-96a290857ed1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:07.852573 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ffddeea3-b7f9-438f-a27a-96a290857ed1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:07.853380 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ffddeea3-b7f9-438f-a27a-96a290857ed1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:07.853812 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ffddeea3-b7f9-438f-a27a-96a290857ed1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:07.924975 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ffddeea3-b7f9-438f-a27a-96a290857ed1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:07.932725 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ffddeea3-b7f9-438f-a27a-96a290857ed1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1298 microversion: 2.1 time: 0.092749 Jul 31 20:00:07.933327 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 44/85] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:07 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:08.559156 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-261f2dc8-1bd3-4458-80c2-388b530b9f07 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:08.565337 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-261f2dc8-1bd3-4458-80c2-388b530b9f07 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:08.572596 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-261f2dc8-1bd3-4458-80c2-388b530b9f07 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:08.573015 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-261f2dc8-1bd3-4458-80c2-388b530b9f07 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:08.574038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-261f2dc8-1bd3-4458-80c2-388b530b9f07 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:08.574796 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-261f2dc8-1bd3-4458-80c2-388b530b9f07 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:08.642752 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-261f2dc8-1bd3-4458-80c2-388b530b9f07 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:08.650699 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-261f2dc8-1bd3-4458-80c2-388b530b9f07 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1273 microversion: 2.1 time: 0.098922 Jul 31 20:00:08.651255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 42/86] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:08 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:08.652230 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0ba44217-cb95-4e10-ad76-8bf9d82cd124 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:08.652838 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0ba44217-cb95-4e10-ad76-8bf9d82cd124 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:08.659518 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0ba44217-cb95-4e10-ad76-8bf9d82cd124 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:08.659898 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0ba44217-cb95-4e10-ad76-8bf9d82cd124 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:08.660682 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0ba44217-cb95-4e10-ad76-8bf9d82cd124 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:08.661103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0ba44217-cb95-4e10-ad76-8bf9d82cd124 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:08.683760 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e3e339a1-246f-4124-91f6-38e42f31e995 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:08.684370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3e339a1-246f-4124-91f6-38e42f31e995 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:08.690549 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3e339a1-246f-4124-91f6-38e42f31e995 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:08.691001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3e339a1-246f-4124-91f6-38e42f31e995 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:08.691751 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3e339a1-246f-4124-91f6-38e42f31e995 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:08.692172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3e339a1-246f-4124-91f6-38e42f31e995 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:08.728629 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0ba44217-cb95-4e10-ad76-8bf9d82cd124 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:08.738130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0ba44217-cb95-4e10-ad76-8bf9d82cd124 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1293 microversion: 2.1 time: 0.089747 Jul 31 20:00:08.739785 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 45/87] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:08 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:08.756604 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-827f8689-ee29-4d70-8519-80dfcb88955b tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:08.757799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-827f8689-ee29-4d70-8519-80dfcb88955b tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:08.764800 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-827f8689-ee29-4d70-8519-80dfcb88955b tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:08.765482 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-827f8689-ee29-4d70-8519-80dfcb88955b tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:08.767755 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-827f8689-ee29-4d70-8519-80dfcb88955b tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:08.768353 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-827f8689-ee29-4d70-8519-80dfcb88955b tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:08.839526 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-827f8689-ee29-4d70-8519-80dfcb88955b tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:08.847276 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-827f8689-ee29-4d70-8519-80dfcb88955b tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1284 microversion: 2.1 time: 0.106192 Jul 31 20:00:08.847819 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 46/88] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:08 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:08.862880 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3e339a1-246f-4124-91f6-38e42f31e995 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:08.872352 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3e339a1-246f-4124-91f6-38e42f31e995 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:08.873893 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3e339a1-246f-4124-91f6-38e42f31e995 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:08.875028 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e3e339a1-246f-4124-91f6-38e42f31e995 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.195057 Jul 31 20:00:08.875577 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 43/89] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:08 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:08.956456 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-df06d6d2-48f1-4284-b706-ab4b15989ee3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:08.956964 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-df06d6d2-48f1-4284-b706-ab4b15989ee3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:08.963421 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-df06d6d2-48f1-4284-b706-ab4b15989ee3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:08.963896 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-df06d6d2-48f1-4284-b706-ab4b15989ee3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:08.964683 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-df06d6d2-48f1-4284-b706-ab4b15989ee3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:08.965110 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-df06d6d2-48f1-4284-b706-ab4b15989ee3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:09.039960 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-df06d6d2-48f1-4284-b706-ab4b15989ee3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:09.051642 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-df06d6d2-48f1-4284-b706-ab4b15989ee3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1298 microversion: 2.1 time: 0.100420 Jul 31 20:00:09.052635 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 47/90] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:08 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:09.671461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1e21695d-0d5f-45aa-b5a1-635c1e242fbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:09.672944 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1e21695d-0d5f-45aa-b5a1-635c1e242fbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:09.681310 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e21695d-0d5f-45aa-b5a1-635c1e242fbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:09.681961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e21695d-0d5f-45aa-b5a1-635c1e242fbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:09.682929 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e21695d-0d5f-45aa-b5a1-635c1e242fbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:09.683549 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e21695d-0d5f-45aa-b5a1-635c1e242fbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:09.763354 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0a29cd07-1ae7-491c-b739-20021cec1de0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:09.763961 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0a29cd07-1ae7-491c-b739-20021cec1de0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:09.770973 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0a29cd07-1ae7-491c-b739-20021cec1de0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:09.771415 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0a29cd07-1ae7-491c-b739-20021cec1de0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:09.772276 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0a29cd07-1ae7-491c-b739-20021cec1de0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:09.772902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0a29cd07-1ae7-491c-b739-20021cec1de0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:09.805902 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1e21695d-0d5f-45aa-b5a1-635c1e242fbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:09.813862 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1e21695d-0d5f-45aa-b5a1-635c1e242fbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1279 microversion: 2.1 time: 0.145972 Jul 31 20:00:09.815205 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 44/91] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:09 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1279 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:09.871357 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ef233a30-b6d2-485d-a30e-322b632c0ab0 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:09.873168 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ef233a30-b6d2-485d-a30e-322b632c0ab0 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:09.881137 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef233a30-b6d2-485d-a30e-322b632c0ab0 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:09.883327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef233a30-b6d2-485d-a30e-322b632c0ab0 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:09.884372 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef233a30-b6d2-485d-a30e-322b632c0ab0 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:09.884995 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef233a30-b6d2-485d-a30e-322b632c0ab0 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:10.092835 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0a29cd07-1ae7-491c-b739-20021cec1de0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:10.101113 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0a29cd07-1ae7-491c-b739-20021cec1de0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1299 microversion: 2.1 time: 0.344718 Jul 31 20:00:10.112674 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 48/92] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:09 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1299 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:10.112674 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-119cea59-8ed8-42e8-a08a-23c07bd326aa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:10.112674 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-119cea59-8ed8-42e8-a08a-23c07bd326aa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:10.122272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-119cea59-8ed8-42e8-a08a-23c07bd326aa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:10.123245 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-119cea59-8ed8-42e8-a08a-23c07bd326aa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:10.124570 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-119cea59-8ed8-42e8-a08a-23c07bd326aa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:10.125200 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-119cea59-8ed8-42e8-a08a-23c07bd326aa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:10.805871 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-119cea59-8ed8-42e8-a08a-23c07bd326aa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:10.822177 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-119cea59-8ed8-42e8-a08a-23c07bd326aa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:10.826144 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-119cea59-8ed8-42e8-a08a-23c07bd326aa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:10.833070 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-119cea59-8ed8-42e8-a08a-23c07bd326aa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.728041 Jul 31 20:00:10.836014 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 49/93] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:10 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:10.843347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0bc33228-1a0c-47e9-aa16-b7c1a286cce0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:10.848355 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0bc33228-1a0c-47e9-aa16-b7c1a286cce0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:10.866287 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bc33228-1a0c-47e9-aa16-b7c1a286cce0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:10.868889 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bc33228-1a0c-47e9-aa16-b7c1a286cce0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:10.871473 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bc33228-1a0c-47e9-aa16-b7c1a286cce0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:10.872458 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bc33228-1a0c-47e9-aa16-b7c1a286cce0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:10.890394 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ef233a30-b6d2-485d-a30e-322b632c0ab0 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:10.905672 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ef233a30-b6d2-485d-a30e-322b632c0ab0 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1314 microversion: 2.1 time: 1.040345 Jul 31 20:00:10.905672 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 45/94] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:09 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1314 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:10.910873 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4c24ba59-ea14-409e-9846-e2ff2d61ec2c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:10.911481 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4c24ba59-ea14-409e-9846-e2ff2d61ec2c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:10.931681 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c24ba59-ea14-409e-9846-e2ff2d61ec2c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:10.931681 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c24ba59-ea14-409e-9846-e2ff2d61ec2c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:10.931681 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c24ba59-ea14-409e-9846-e2ff2d61ec2c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:10.931681 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c24ba59-ea14-409e-9846-e2ff2d61ec2c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:11.101694 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0bc33228-1a0c-47e9-aa16-b7c1a286cce0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:11.111458 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0bc33228-1a0c-47e9-aa16-b7c1a286cce0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1296 microversion: 2.1 time: 0.273692 Jul 31 20:00:11.111612 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 50/95] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:10 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1296 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:11.130601 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-87907a71-355a-45a8-ab4e-ba9028b5c294 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:11.131256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-87907a71-355a-45a8-ab4e-ba9028b5c294 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:11.141669 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-87907a71-355a-45a8-ab4e-ba9028b5c294 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:11.142113 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-87907a71-355a-45a8-ab4e-ba9028b5c294 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:11.145667 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-87907a71-355a-45a8-ab4e-ba9028b5c294 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:11.146306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-87907a71-355a-45a8-ab4e-ba9028b5c294 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:11.165011 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4c24ba59-ea14-409e-9846-e2ff2d61ec2c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:11.174172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4c24ba59-ea14-409e-9846-e2ff2d61ec2c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1279 microversion: 2.1 time: 0.266676 Jul 31 20:00:11.175958 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 46/96] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:10 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1279 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:11.529799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-87907a71-355a-45a8-ab4e-ba9028b5c294 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:11.544725 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-87907a71-355a-45a8-ab4e-ba9028b5c294 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1367 microversion: 2.1 time: 0.422052 Jul 31 20:00:11.546247 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 51/97] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:11 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:11.870675 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-604a7b77-0b20-4c9d-b689-a8cf72f921be tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:11.873501 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-604a7b77-0b20-4c9d-b689-a8cf72f921be tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:11.891926 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-604a7b77-0b20-4c9d-b689-a8cf72f921be tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:11.895298 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-604a7b77-0b20-4c9d-b689-a8cf72f921be tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:11.900047 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-604a7b77-0b20-4c9d-b689-a8cf72f921be tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:11.902665 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-604a7b77-0b20-4c9d-b689-a8cf72f921be tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:11.926960 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-821831aa-cca7-464f-b57c-9516c96b8d79 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:11.928210 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-821831aa-cca7-464f-b57c-9516c96b8d79 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:11.934986 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-821831aa-cca7-464f-b57c-9516c96b8d79 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:11.935417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-821831aa-cca7-464f-b57c-9516c96b8d79 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:11.936183 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-821831aa-cca7-464f-b57c-9516c96b8d79 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:11.936611 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-821831aa-cca7-464f-b57c-9516c96b8d79 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:12.834017 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-604a7b77-0b20-4c9d-b689-a8cf72f921be tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:12.857123 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-821831aa-cca7-464f-b57c-9516c96b8d79 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:12.864002 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-604a7b77-0b20-4c9d-b689-a8cf72f921be tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:12.866811 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-604a7b77-0b20-4c9d-b689-a8cf72f921be tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:12.868131 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-604a7b77-0b20-4c9d-b689-a8cf72f921be tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 1.014718 Jul 31 20:00:12.870643 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-821831aa-cca7-464f-b57c-9516c96b8d79 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1314 microversion: 2.1 time: 0.945750 Jul 31 20:00:12.871580 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 52/98] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:11 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1314 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:12.882328 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 47/99] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:11 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:12.890267 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d8ff3c2c-bd74-4893-887e-6b6c6b7a9026 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:12.891334 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d8ff3c2c-bd74-4893-887e-6b6c6b7a9026 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:12.897919 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8ff3c2c-bd74-4893-887e-6b6c6b7a9026 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:12.899690 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8ff3c2c-bd74-4893-887e-6b6c6b7a9026 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:12.900708 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8ff3c2c-bd74-4893-887e-6b6c6b7a9026 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:12.901318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8ff3c2c-bd74-4893-887e-6b6c6b7a9026 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:12.977433 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-166fdf2d-2ee8-4d51-ad33-b0b1bdb7fc80 req-81d3dfcb-821d-40ca-9c33-72ed9fa8a3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef21f87f-e509-4c7d-883c-3e0f5d0672de", "tag": "a4ca66a2-1746-449b-8904-3d6445d22f14"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:12.990016 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-166fdf2d-2ee8-4d51-ad33-b0b1bdb7fc80 req-81d3dfcb-821d-40ca-9c33-72ed9fa8a3f3 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:12.990428 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-166fdf2d-2ee8-4d51-ad33-b0b1bdb7fc80 req-81d3dfcb-821d-40ca-9c33-72ed9fa8a3f3 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:13.010026 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-166fdf2d-2ee8-4d51-ad33-b0b1bdb7fc80 req-81d3dfcb-821d-40ca-9c33-72ed9fa8a3f3 service nova] Creating event network-changed:a4ca66a2-1746-449b-8904-3d6445d22f14 for instance ef21f87f-e509-4c7d-883c-3e0f5d0672de on hv-cinder-84984 Jul 31 20:00:13.010560 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-166fdf2d-2ee8-4d51-ad33-b0b1bdb7fc80 req-81d3dfcb-821d-40ca-9c33-72ed9fa8a3f3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 20:00:13.012000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e682b393-7701-4bd4-b131-8a7fc024e416 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:13.012434 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e682b393-7701-4bd4-b131-8a7fc024e416 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:13.013411 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e682b393-7701-4bd4-b131-8a7fc024e416 None None] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:13.014283 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e682b393-7701-4bd4-b131-8a7fc024e416 None None] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:13.023831 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.compute.rpcapi [None req-e682b393-7701-4bd4-b131-8a7fc024e416 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 31 20:00:13.024688 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e682b393-7701-4bd4-b131-8a7fc024e416 None None] Releasing lock "compute-rpcapi-router" {{(pid=117919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 20:00:13.063598 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e682b393-7701-4bd4-b131-8a7fc024e416 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190428 Jul 31 20:00:13.064584 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 53/100] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:00:13.070345 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-409f0b0e-8011-4f30-8bef-75e8b27648f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:13.071135 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-409f0b0e-8011-4f30-8bef-75e8b27648f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:13.078100 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-409f0b0e-8011-4f30-8bef-75e8b27648f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:13.078541 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-409f0b0e-8011-4f30-8bef-75e8b27648f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:13.079533 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-409f0b0e-8011-4f30-8bef-75e8b27648f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:13.080122 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-409f0b0e-8011-4f30-8bef-75e8b27648f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:13.192542 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-409f0b0e-8011-4f30-8bef-75e8b27648f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:13.200343 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-409f0b0e-8011-4f30-8bef-75e8b27648f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1279 microversion: 2.1 time: 0.134588 Jul 31 20:00:13.200977 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 54/101] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:13 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1279 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:13.205727 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-843c62c5-3156-4a7d-af7d-ddd79a28a300 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:13.206367 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-843c62c5-3156-4a7d-af7d-ddd79a28a300 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:13.213173 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-843c62c5-3156-4a7d-af7d-ddd79a28a300 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:13.213919 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-843c62c5-3156-4a7d-af7d-ddd79a28a300 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:13.214657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-843c62c5-3156-4a7d-af7d-ddd79a28a300 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:13.215239 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-843c62c5-3156-4a7d-af7d-ddd79a28a300 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:13.282280 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d8ff3c2c-bd74-4893-887e-6b6c6b7a9026 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:13.291167 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d8ff3c2c-bd74-4893-887e-6b6c6b7a9026 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1362 microversion: 2.1 time: 0.407135 Jul 31 20:00:13.306040 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 48/102] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:12 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:13.457535 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-5ea0032f-f737-4b4d-9cac-7e447466a4ea req-8674ed63-87f4-4dd4-843f-9bab83fb5669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb0b91c-9a78-49a1-a96b-016c09759655", "tag": "eaea7f4e-af98-4acb-9edb-366b7b6e28d8"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:13.484540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-843c62c5-3156-4a7d-af7d-ddd79a28a300 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:13.496641 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-843c62c5-3156-4a7d-af7d-ddd79a28a300 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1367 microversion: 2.1 time: 0.294228 Jul 31 20:00:13.506901 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5ea0032f-f737-4b4d-9cac-7e447466a4ea req-8674ed63-87f4-4dd4-843f-9bab83fb5669 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:13.507573 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5ea0032f-f737-4b4d-9cac-7e447466a4ea req-8674ed63-87f4-4dd4-843f-9bab83fb5669 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:13.511302 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 55/103] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:13 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:13.528195 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-5ea0032f-f737-4b4d-9cac-7e447466a4ea req-8674ed63-87f4-4dd4-843f-9bab83fb5669 service nova] Creating event network-changed:eaea7f4e-af98-4acb-9edb-366b7b6e28d8 for instance cdb0b91c-9a78-49a1-a96b-016c09759655 on hv-cinder-84984 Jul 31 20:00:13.528796 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5ea0032f-f737-4b4d-9cac-7e447466a4ea req-8674ed63-87f4-4dd4-843f-9bab83fb5669 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 20:00:13.530112 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0dec1586-31fe-4b24-a541-5bcc28218392 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:13.530761 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0dec1586-31fe-4b24-a541-5bcc28218392 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:13.531727 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0dec1586-31fe-4b24-a541-5bcc28218392 None None] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:13.532384 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0dec1586-31fe-4b24-a541-5bcc28218392 None None] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:13.542741 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.compute.rpcapi [None req-0dec1586-31fe-4b24-a541-5bcc28218392 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 31 20:00:13.543642 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0dec1586-31fe-4b24-a541-5bcc28218392 None None] Releasing lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 20:00:13.563965 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0dec1586-31fe-4b24-a541-5bcc28218392 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267845 Jul 31 20:00:13.564914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 49/104] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:00:13.899717 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-975cb557-8493-461f-ab84-203e99c22a98 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:13.900311 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-975cb557-8493-461f-ab84-203e99c22a98 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:13.904291 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7b47669d-7d63-4b73-b7db-0f59db3dbe3f tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:13.905217 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7b47669d-7d63-4b73-b7db-0f59db3dbe3f tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:13.907981 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-975cb557-8493-461f-ab84-203e99c22a98 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:13.908573 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-975cb557-8493-461f-ab84-203e99c22a98 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:13.909498 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-975cb557-8493-461f-ab84-203e99c22a98 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:13.910731 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-975cb557-8493-461f-ab84-203e99c22a98 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:13.915800 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b47669d-7d63-4b73-b7db-0f59db3dbe3f tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:13.916158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b47669d-7d63-4b73-b7db-0f59db3dbe3f tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:13.919022 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b47669d-7d63-4b73-b7db-0f59db3dbe3f tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:13.919656 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b47669d-7d63-4b73-b7db-0f59db3dbe3f tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:14.698088 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-975cb557-8493-461f-ab84-203e99c22a98 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:14.706698 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-975cb557-8493-461f-ab84-203e99c22a98 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:14.708433 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-975cb557-8493-461f-ab84-203e99c22a98 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:14.709904 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-975cb557-8493-461f-ab84-203e99c22a98 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.818438 Jul 31 20:00:14.710615 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 56/105] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:13 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:00:14.726734 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7b47669d-7d63-4b73-b7db-0f59db3dbe3f tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:14.730335 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-72d5dbd9-df8e-4b9b-ad44-84d5c0c0cee1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:14.730952 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-72d5dbd9-df8e-4b9b-ad44-84d5c0c0cee1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:14.735456 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7b47669d-7d63-4b73-b7db-0f59db3dbe3f tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1314 microversion: 2.1 time: 0.837216 Jul 31 20:00:14.736533 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 50/106] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:13 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1314 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:14.746903 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72d5dbd9-df8e-4b9b-ad44-84d5c0c0cee1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:14.747350 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72d5dbd9-df8e-4b9b-ad44-84d5c0c0cee1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:14.748127 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72d5dbd9-df8e-4b9b-ad44-84d5c0c0cee1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:14.748554 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72d5dbd9-df8e-4b9b-ad44-84d5c0c0cee1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:14.750003 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7443e0af-c7b9-443f-bbc1-92cc862f79bc tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:14.750817 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7443e0af-c7b9-443f-bbc1-92cc862f79bc tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:14.757922 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7443e0af-c7b9-443f-bbc1-92cc862f79bc tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:14.758763 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7443e0af-c7b9-443f-bbc1-92cc862f79bc tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:14.759509 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7443e0af-c7b9-443f-bbc1-92cc862f79bc tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:14.759962 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7443e0af-c7b9-443f-bbc1-92cc862f79bc tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:15.582316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7443e0af-c7b9-443f-bbc1-92cc862f79bc tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:15.592689 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7443e0af-c7b9-443f-bbc1-92cc862f79bc tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1362 microversion: 2.1 time: 0.854908 Jul 31 20:00:15.593285 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 51/107] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:14 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1362 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:15.606195 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1432e5d1-453e-4881-bb61-efe77ac13a45 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:15.606929 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1432e5d1-453e-4881-bb61-efe77ac13a45 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:15.614888 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1432e5d1-453e-4881-bb61-efe77ac13a45 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:15.615702 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1432e5d1-453e-4881-bb61-efe77ac13a45 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:15.616667 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1432e5d1-453e-4881-bb61-efe77ac13a45 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:15.617931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1432e5d1-453e-4881-bb61-efe77ac13a45 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:15.625595 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-72d5dbd9-df8e-4b9b-ad44-84d5c0c0cee1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:15.637824 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-72d5dbd9-df8e-4b9b-ad44-84d5c0c0cee1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.911913 Jul 31 20:00:15.638622 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 57/108] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:14 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:15.643380 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-e9ebff73-8576-43d2-a609-7cfcf55b8fc8 req-4380d947-d057-4f1c-9efe-4dea743d55d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "176aa7ed-3c42-4749-852d-a397673e4e57", "tag": "2a807f69-4e6e-4e5f-9403-2f792246e051"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:15.665125 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e9ebff73-8576-43d2-a609-7cfcf55b8fc8 req-4380d947-d057-4f1c-9efe-4dea743d55d4 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:15.667994 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e9ebff73-8576-43d2-a609-7cfcf55b8fc8 req-4380d947-d057-4f1c-9efe-4dea743d55d4 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:15.691642 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-e9ebff73-8576-43d2-a609-7cfcf55b8fc8 req-4380d947-d057-4f1c-9efe-4dea743d55d4 service nova] Creating event network-changed:2a807f69-4e6e-4e5f-9403-2f792246e051 for instance 176aa7ed-3c42-4749-852d-a397673e4e57 on hv-cinder-84984 Jul 31 20:00:15.696713 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-e9ebff73-8576-43d2-a609-7cfcf55b8fc8 req-4380d947-d057-4f1c-9efe-4dea743d55d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056790 Jul 31 20:00:15.697561 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 58/109] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:00:15.703596 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-bdc45577-c28e-4fee-ab4b-eca1c5682508 req-c9e3e59d-bea2-4ae0-a574-5544188b7096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a098dc51-df70-4d1b-ae0b-264fdb83e932", "tag": "95267dcb-4338-43ed-96fe-5c4a8c8ee0dd"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:15.713672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-bdc45577-c28e-4fee-ab4b-eca1c5682508 req-c9e3e59d-bea2-4ae0-a574-5544188b7096 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:15.714037 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-bdc45577-c28e-4fee-ab4b-eca1c5682508 req-c9e3e59d-bea2-4ae0-a574-5544188b7096 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:15.728301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-bdc45577-c28e-4fee-ab4b-eca1c5682508 req-c9e3e59d-bea2-4ae0-a574-5544188b7096 service nova] Creating event network-changed:95267dcb-4338-43ed-96fe-5c4a8c8ee0dd for instance a098dc51-df70-4d1b-ae0b-264fdb83e932 on hv-cinder-84984 Jul 31 20:00:15.734628 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-bdc45577-c28e-4fee-ab4b-eca1c5682508 req-c9e3e59d-bea2-4ae0-a574-5544188b7096 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034606 Jul 31 20:00:15.734853 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 59/110] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:00:15.740219 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5b793572-3c2c-4cd2-88c7-f4fd621626c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:15.741041 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5b793572-3c2c-4cd2-88c7-f4fd621626c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:15.750658 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b793572-3c2c-4cd2-88c7-f4fd621626c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:15.751471 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b793572-3c2c-4cd2-88c7-f4fd621626c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:15.752882 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b793572-3c2c-4cd2-88c7-f4fd621626c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:15.753786 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b793572-3c2c-4cd2-88c7-f4fd621626c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:16.073107 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1432e5d1-453e-4881-bb61-efe77ac13a45 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:16.084220 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1432e5d1-453e-4881-bb61-efe77ac13a45 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1367 microversion: 2.1 time: 0.489598 Jul 31 20:00:16.085548 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 52/111] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:15 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:16.093673 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7b4e738a-dffc-4424-91ef-8dcb249392cc tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:16.094827 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7b4e738a-dffc-4424-91ef-8dcb249392cc tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:16.112527 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b4e738a-dffc-4424-91ef-8dcb249392cc tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:16.113237 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b4e738a-dffc-4424-91ef-8dcb249392cc tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:16.114466 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b4e738a-dffc-4424-91ef-8dcb249392cc tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:16.114953 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b4e738a-dffc-4424-91ef-8dcb249392cc tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:16.147423 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5b793572-3c2c-4cd2-88c7-f4fd621626c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:16.155783 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5b793572-3c2c-4cd2-88c7-f4fd621626c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:16.158041 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5b793572-3c2c-4cd2-88c7-f4fd621626c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:16.159306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5b793572-3c2c-4cd2-88c7-f4fd621626c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.423324 Jul 31 20:00:16.160048 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 60/112] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:15 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:16.420763 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7b4e738a-dffc-4424-91ef-8dcb249392cc tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:16.451339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7b4e738a-dffc-4424-91ef-8dcb249392cc tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1314 microversion: 2.1 time: 0.363125 Jul 31 20:00:16.451922 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 53/113] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:16 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:16.613649 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6b5a52c9-659f-48ee-87f2-07f3b59a2445 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:16.614245 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6b5a52c9-659f-48ee-87f2-07f3b59a2445 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:16.620571 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b5a52c9-659f-48ee-87f2-07f3b59a2445 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:16.621007 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b5a52c9-659f-48ee-87f2-07f3b59a2445 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:16.621825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b5a52c9-659f-48ee-87f2-07f3b59a2445 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:16.622231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b5a52c9-659f-48ee-87f2-07f3b59a2445 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:16.640090 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:16.659100 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fa5ed945-5af5-4599-a21a-6373b7beb54b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:16.659864 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fa5ed945-5af5-4599-a21a-6373b7beb54b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:16.666979 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa5ed945-5af5-4599-a21a-6373b7beb54b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:16.667430 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa5ed945-5af5-4599-a21a-6373b7beb54b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:16.668207 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa5ed945-5af5-4599-a21a-6373b7beb54b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:16.668814 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa5ed945-5af5-4599-a21a-6373b7beb54b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:16.861792 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6b5a52c9-659f-48ee-87f2-07f3b59a2445 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:16.871611 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6b5a52c9-659f-48ee-87f2-07f3b59a2445 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1362 microversion: 2.1 time: 0.261738 Jul 31 20:00:16.872126 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fa5ed945-5af5-4599-a21a-6373b7beb54b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:16.872550 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 61/114] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:16 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:16.887139 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fa5ed945-5af5-4599-a21a-6373b7beb54b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.232520 Jul 31 20:00:16.887860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 54/115] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:16 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:17.107198 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4c2fb580-d0a8-40ee-8c14-0c78c5727937 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:17.107810 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4c2fb580-d0a8-40ee-8c14-0c78c5727937 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:17.114049 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c2fb580-d0a8-40ee-8c14-0c78c5727937 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:17.114500 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c2fb580-d0a8-40ee-8c14-0c78c5727937 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:17.115282 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c2fb580-d0a8-40ee-8c14-0c78c5727937 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:17.115710 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c2fb580-d0a8-40ee-8c14-0c78c5727937 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:17.187329 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1157fded-a57b-421f-8ea5-cefa80ee0aab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:17.188338 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1157fded-a57b-421f-8ea5-cefa80ee0aab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:17.195524 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1157fded-a57b-421f-8ea5-cefa80ee0aab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:17.195944 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1157fded-a57b-421f-8ea5-cefa80ee0aab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:17.196755 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1157fded-a57b-421f-8ea5-cefa80ee0aab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:17.197529 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1157fded-a57b-421f-8ea5-cefa80ee0aab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:17.308807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4c2fb580-d0a8-40ee-8c14-0c78c5727937 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:17.316653 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4c2fb580-d0a8-40ee-8c14-0c78c5727937 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1367 microversion: 2.1 time: 0.213284 Jul 31 20:00:17.317253 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 62/116] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:17 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:17.356946 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1157fded-a57b-421f-8ea5-cefa80ee0aab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:17.365047 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1157fded-a57b-421f-8ea5-cefa80ee0aab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:17.366566 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1157fded-a57b-421f-8ea5-cefa80ee0aab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:17.367659 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1157fded-a57b-421f-8ea5-cefa80ee0aab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.185042 Jul 31 20:00:17.368214 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 55/117] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:17 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:17.473467 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-eb82cde5-46b4-4baa-9307-1cdfe3a4f0af tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:17.474221 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-eb82cde5-46b4-4baa-9307-1cdfe3a4f0af tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:17.480661 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb82cde5-46b4-4baa-9307-1cdfe3a4f0af tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:17.481106 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb82cde5-46b4-4baa-9307-1cdfe3a4f0af tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:17.481879 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb82cde5-46b4-4baa-9307-1cdfe3a4f0af tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:17.482544 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb82cde5-46b4-4baa-9307-1cdfe3a4f0af tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:17.622095 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-eb82cde5-46b4-4baa-9307-1cdfe3a4f0af tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:17.631206 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-eb82cde5-46b4-4baa-9307-1cdfe3a4f0af tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1314 microversion: 2.1 time: 0.161479 Jul 31 20:00:17.631854 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 63/118] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:17 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:17.778458 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-0a8749c9-58a1-4274-a068-f9c73afa1a47 req-c4744c02-a11f-43d9-9aaa-5a68df583da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ecd0dfe-455d-48b5-bae6-6f0544738769", "tag": "cfa02dcb-7408-495e-8b94-f4b8c7c96142"}, {"name": "network-changed", "server_uuid": "bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485", "tag": "b365ebcd-da3b-4922-a38f-6b3e66392c64"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:17.789430 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0a8749c9-58a1-4274-a068-f9c73afa1a47 req-c4744c02-a11f-43d9-9aaa-5a68df583da4 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:17.790035 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0a8749c9-58a1-4274-a068-f9c73afa1a47 req-c4744c02-a11f-43d9-9aaa-5a68df583da4 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:17.804456 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-0a8749c9-58a1-4274-a068-f9c73afa1a47 req-c4744c02-a11f-43d9-9aaa-5a68df583da4 service nova] Creating event network-changed:cfa02dcb-7408-495e-8b94-f4b8c7c96142 for instance 8ecd0dfe-455d-48b5-bae6-6f0544738769 on hv-cinder-84984 Jul 31 20:00:17.805016 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-0a8749c9-58a1-4274-a068-f9c73afa1a47 req-c4744c02-a11f-43d9-9aaa-5a68df583da4 service nova] Creating event network-changed:b365ebcd-da3b-4922-a38f-6b3e66392c64 for instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 on hv-cinder-84984 Jul 31 20:00:17.811674 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-0a8749c9-58a1-4274-a068-f9c73afa1a47 req-c4744c02-a11f-43d9-9aaa-5a68df583da4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038020 Jul 31 20:00:17.812236 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 56/119] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:00:17.892464 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ec114cf1-27f9-4ffb-a842-806a1a5eb031 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:17.893090 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ec114cf1-27f9-4ffb-a842-806a1a5eb031 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:17.899587 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec114cf1-27f9-4ffb-a842-806a1a5eb031 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:17.900084 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec114cf1-27f9-4ffb-a842-806a1a5eb031 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:17.900875 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec114cf1-27f9-4ffb-a842-806a1a5eb031 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:17.901345 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec114cf1-27f9-4ffb-a842-806a1a5eb031 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:17.908241 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ebebee6c-2dd0-4163-9068-0014afe97282 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:17.909243 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ebebee6c-2dd0-4163-9068-0014afe97282 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:17.915591 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ebebee6c-2dd0-4163-9068-0014afe97282 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:17.916150 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ebebee6c-2dd0-4163-9068-0014afe97282 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:17.917138 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ebebee6c-2dd0-4163-9068-0014afe97282 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:17.917651 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ebebee6c-2dd0-4163-9068-0014afe97282 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:18.127333 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ebebee6c-2dd0-4163-9068-0014afe97282 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:18.131396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ec114cf1-27f9-4ffb-a842-806a1a5eb031 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:18.143075 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ec114cf1-27f9-4ffb-a842-806a1a5eb031 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1362 microversion: 2.1 time: 0.254957 Jul 31 20:00:18.143666 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 64/120] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:17 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:18.148162 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ebebee6c-2dd0-4163-9068-0014afe97282 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.243960 Jul 31 20:00:18.149045 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 57/121] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:17 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:18.337179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f3738ff9-fa4c-4bb9-97c0-69252423e3aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:18.338004 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f3738ff9-fa4c-4bb9-97c0-69252423e3aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:18.344106 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3738ff9-fa4c-4bb9-97c0-69252423e3aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:18.344677 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3738ff9-fa4c-4bb9-97c0-69252423e3aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:18.345445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3738ff9-fa4c-4bb9-97c0-69252423e3aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:18.345871 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3738ff9-fa4c-4bb9-97c0-69252423e3aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:18.390025 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ea179169-6d4c-4c12-9177-f91d472f698c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:18.390543 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ea179169-6d4c-4c12-9177-f91d472f698c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:18.397034 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea179169-6d4c-4c12-9177-f91d472f698c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:18.397526 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea179169-6d4c-4c12-9177-f91d472f698c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:18.398288 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea179169-6d4c-4c12-9177-f91d472f698c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:18.398720 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea179169-6d4c-4c12-9177-f91d472f698c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:19.052500 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f3738ff9-fa4c-4bb9-97c0-69252423e3aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:19.063742 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f3738ff9-fa4c-4bb9-97c0-69252423e3aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1367 microversion: 2.1 time: 0.728509 Jul 31 20:00:19.064637 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 65/122] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:18 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1367 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:19.078081 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-af5c1ff6-2ebc-46f6-8b30-97082c32b204 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:19.079278 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-af5c1ff6-2ebc-46f6-8b30-97082c32b204 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:19.091823 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af5c1ff6-2ebc-46f6-8b30-97082c32b204 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:19.093887 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af5c1ff6-2ebc-46f6-8b30-97082c32b204 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:19.095599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af5c1ff6-2ebc-46f6-8b30-97082c32b204 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:19.097198 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af5c1ff6-2ebc-46f6-8b30-97082c32b204 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:19.320119 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ea179169-6d4c-4c12-9177-f91d472f698c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:19.326508 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:19.335247 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ea179169-6d4c-4c12-9177-f91d472f698c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:19.337549 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ea179169-6d4c-4c12-9177-f91d472f698c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:19.339192 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ea179169-6d4c-4c12-9177-f91d472f698c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.953116 Jul 31 20:00:19.340810 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 58/123] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:18 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:19.347891 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b12e5624-78f0-4830-a819-ee75b6309650 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:19.348771 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b12e5624-78f0-4830-a819-ee75b6309650 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:19.373394 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12e5624-78f0-4830-a819-ee75b6309650 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:19.374062 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12e5624-78f0-4830-a819-ee75b6309650 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:19.375058 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12e5624-78f0-4830-a819-ee75b6309650 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:19.375704 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12e5624-78f0-4830-a819-ee75b6309650 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:19.649198 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-af5c1ff6-2ebc-46f6-8b30-97082c32b204 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:19.657600 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-af5c1ff6-2ebc-46f6-8b30-97082c32b204 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1314 microversion: 2.1 time: 0.590729 Jul 31 20:00:19.658402 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 66/124] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:19 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:19.664395 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9edc72ce-82e1-439c-a347-aba7bf8403d7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:19.665069 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9edc72ce-82e1-439c-a347-aba7bf8403d7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:19.673278 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9edc72ce-82e1-439c-a347-aba7bf8403d7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:19.673842 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9edc72ce-82e1-439c-a347-aba7bf8403d7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:19.674866 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9edc72ce-82e1-439c-a347-aba7bf8403d7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:19.675386 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9edc72ce-82e1-439c-a347-aba7bf8403d7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:19.692662 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b12e5624-78f0-4830-a819-ee75b6309650 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:19.701485 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b12e5624-78f0-4830-a819-ee75b6309650 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1362 microversion: 2.1 time: 0.359040 Jul 31 20:00:19.702064 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 59/125] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:19 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:19.830618 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9edc72ce-82e1-439c-a347-aba7bf8403d7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:19.841142 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9edc72ce-82e1-439c-a347-aba7bf8403d7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.180905 Jul 31 20:00:19.842576 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 67/126] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:19 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:19.853576 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-c0e81b02-c698-4f63-b6ce-be5fd1057246 req-0f31253b-d45d-47fa-b71c-7fb47da57de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef21f87f-e509-4c7d-883c-3e0f5d0672de", "name": "network-vif-plugged", "status": "completed", "tag": "a4ca66a2-1746-449b-8904-3d6445d22f14"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:19.863590 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c0e81b02-c698-4f63-b6ce-be5fd1057246 req-0f31253b-d45d-47fa-b71c-7fb47da57de2 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:19.864138 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c0e81b02-c698-4f63-b6ce-be5fd1057246 req-0f31253b-d45d-47fa-b71c-7fb47da57de2 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:19.875697 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-c0e81b02-c698-4f63-b6ce-be5fd1057246 req-0f31253b-d45d-47fa-b71c-7fb47da57de2 service nova] Creating event network-vif-plugged:a4ca66a2-1746-449b-8904-3d6445d22f14 for instance ef21f87f-e509-4c7d-883c-3e0f5d0672de on hv-cinder-84984 Jul 31 20:00:19.880860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-c0e81b02-c698-4f63-b6ce-be5fd1057246 req-0f31253b-d45d-47fa-b71c-7fb47da57de2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177614 Jul 31 20:00:19.884365 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 60/127] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:00:20.084099 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4b04966a-047c-4720-a9fa-6fc4280894a6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:20.085064 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4b04966a-047c-4720-a9fa-6fc4280894a6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:20.093849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4b04966a-047c-4720-a9fa-6fc4280894a6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:20.096612 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4b04966a-047c-4720-a9fa-6fc4280894a6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:20.098784 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4b04966a-047c-4720-a9fa-6fc4280894a6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:20.099149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4b04966a-047c-4720-a9fa-6fc4280894a6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:20.366365 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2e3b5bc2-0209-407e-bcc4-386f36fa6c78 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:20.368161 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2e3b5bc2-0209-407e-bcc4-386f36fa6c78 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:20.378504 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e3b5bc2-0209-407e-bcc4-386f36fa6c78 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:20.379455 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e3b5bc2-0209-407e-bcc4-386f36fa6c78 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:20.380641 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e3b5bc2-0209-407e-bcc4-386f36fa6c78 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:20.381127 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e3b5bc2-0209-407e-bcc4-386f36fa6c78 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:20.703443 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4b04966a-047c-4720-a9fa-6fc4280894a6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:20.713461 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4b04966a-047c-4720-a9fa-6fc4280894a6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1367 microversion: 2.1 time: 0.633293 Jul 31 20:00:20.730454 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 68/128] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:20 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1367 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:20.736747 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-21056b49-ddc0-497c-9699-001dcb3ec1e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:20.737537 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-21056b49-ddc0-497c-9699-001dcb3ec1e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:20.744711 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21056b49-ddc0-497c-9699-001dcb3ec1e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:20.745586 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21056b49-ddc0-497c-9699-001dcb3ec1e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:20.746748 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21056b49-ddc0-497c-9699-001dcb3ec1e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:20.747430 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21056b49-ddc0-497c-9699-001dcb3ec1e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:20.810438 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2e3b5bc2-0209-407e-bcc4-386f36fa6c78 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:20.818846 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2e3b5bc2-0209-407e-bcc4-386f36fa6c78 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:20.820406 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2e3b5bc2-0209-407e-bcc4-386f36fa6c78 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:20.821576 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2e3b5bc2-0209-407e-bcc4-386f36fa6c78 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.460217 Jul 31 20:00:20.822138 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 61/129] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:20 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:20.827732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aee64df0-d989-405c-84c8-63197a52c5fd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:20.828525 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aee64df0-d989-405c-84c8-63197a52c5fd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:20.836020 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aee64df0-d989-405c-84c8-63197a52c5fd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:20.837023 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aee64df0-d989-405c-84c8-63197a52c5fd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:20.837978 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aee64df0-d989-405c-84c8-63197a52c5fd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:20.838588 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aee64df0-d989-405c-84c8-63197a52c5fd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:21.019890 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-21056b49-ddc0-497c-9699-001dcb3ec1e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:21.023117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aee64df0-d989-405c-84c8-63197a52c5fd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:21.031320 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-21056b49-ddc0-497c-9699-001dcb3ec1e2 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1314 microversion: 2.1 time: 0.297906 Jul 31 20:00:21.032414 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 69/130] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:20 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:21.039414 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c0898bd2-5dc2-4e72-ab0b-2266941dd080 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:21.040183 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c0898bd2-5dc2-4e72-ab0b-2266941dd080 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:21.051457 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aee64df0-d989-405c-84c8-63197a52c5fd tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1362 microversion: 2.1 time: 0.227956 Jul 31 20:00:21.052066 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 62/131] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:20 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:21.053499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:21.055899 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0898bd2-5dc2-4e72-ab0b-2266941dd080 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:21.056529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0898bd2-5dc2-4e72-ab0b-2266941dd080 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:21.057595 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0898bd2-5dc2-4e72-ab0b-2266941dd080 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:21.058167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0898bd2-5dc2-4e72-ab0b-2266941dd080 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:21.207488 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c0898bd2-5dc2-4e72-ab0b-2266941dd080 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:21.218475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c0898bd2-5dc2-4e72-ab0b-2266941dd080 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.183432 Jul 31 20:00:21.219060 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 70/132] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:21 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:21.740828 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-498c482a-2fba-413a-ae3f-6f8b5843afdd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:21.741617 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-498c482a-2fba-413a-ae3f-6f8b5843afdd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:21.748252 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-498c482a-2fba-413a-ae3f-6f8b5843afdd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:21.748626 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-498c482a-2fba-413a-ae3f-6f8b5843afdd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:21.749417 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-498c482a-2fba-413a-ae3f-6f8b5843afdd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:21.749903 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-498c482a-2fba-413a-ae3f-6f8b5843afdd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:21.851162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0f162e63-1b16-4995-9468-4bf67d325936 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:21.851927 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0f162e63-1b16-4995-9468-4bf67d325936 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:21.865194 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0f162e63-1b16-4995-9468-4bf67d325936 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:21.865518 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0f162e63-1b16-4995-9468-4bf67d325936 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:21.866504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0f162e63-1b16-4995-9468-4bf67d325936 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:21.866936 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0f162e63-1b16-4995-9468-4bf67d325936 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:22.326694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-498c482a-2fba-413a-ae3f-6f8b5843afdd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:22.342042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-498c482a-2fba-413a-ae3f-6f8b5843afdd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1367 microversion: 2.1 time: 0.598738 Jul 31 20:00:22.345177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 63/133] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:21 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1367 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:22.354198 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-08e28324-8c1c-4dd1-a210-9a4ab2ff205a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:22.355414 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-08e28324-8c1c-4dd1-a210-9a4ab2ff205a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:22.365348 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08e28324-8c1c-4dd1-a210-9a4ab2ff205a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:22.366485 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08e28324-8c1c-4dd1-a210-9a4ab2ff205a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:22.371363 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08e28324-8c1c-4dd1-a210-9a4ab2ff205a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:22.372861 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08e28324-8c1c-4dd1-a210-9a4ab2ff205a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:22.690287 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0f162e63-1b16-4995-9468-4bf67d325936 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:22.703659 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0f162e63-1b16-4995-9468-4bf67d325936 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:22.706892 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0f162e63-1b16-4995-9468-4bf67d325936 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:22.708017 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0f162e63-1b16-4995-9468-4bf67d325936 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.861551 Jul 31 20:00:22.709194 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 71/134] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:21 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:22.714630 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7dbaa4c8-fa8a-48ae-8c83-443084b71a21 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:22.715531 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7dbaa4c8-fa8a-48ae-8c83-443084b71a21 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:22.725042 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7dbaa4c8-fa8a-48ae-8c83-443084b71a21 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:22.726304 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7dbaa4c8-fa8a-48ae-8c83-443084b71a21 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:22.727227 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7dbaa4c8-fa8a-48ae-8c83-443084b71a21 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:22.727806 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7dbaa4c8-fa8a-48ae-8c83-443084b71a21 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:22.956942 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-08e28324-8c1c-4dd1-a210-9a4ab2ff205a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:22.968517 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-08e28324-8c1c-4dd1-a210-9a4ab2ff205a tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1314 microversion: 2.1 time: 0.620899 Jul 31 20:00:22.969232 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 64/135] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:22 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:22.973700 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9ada7486-dc41-44b0-b62e-04558c6e84ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:22.983759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9ada7486-dc41-44b0-b62e-04558c6e84ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:23.003913 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ada7486-dc41-44b0-b62e-04558c6e84ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:23.005213 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ada7486-dc41-44b0-b62e-04558c6e84ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:23.005993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ada7486-dc41-44b0-b62e-04558c6e84ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:23.006409 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ada7486-dc41-44b0-b62e-04558c6e84ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:23.022248 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:23.258235 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7dbaa4c8-fa8a-48ae-8c83-443084b71a21 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:23.266728 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7dbaa4c8-fa8a-48ae-8c83-443084b71a21 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1362 microversion: 2.1 time: 0.555990 Jul 31 20:00:23.268340 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 72/136] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:22 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1362 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:23.355889 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9ada7486-dc41-44b0-b62e-04558c6e84ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:23.364030 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9ada7486-dc41-44b0-b62e-04558c6e84ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.393821 Jul 31 20:00:23.377260 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-84470cbb-9605-4514-8088-5620bd1039d2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:23.377260 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-84470cbb-9605-4514-8088-5620bd1039d2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:23.377260 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84470cbb-9605-4514-8088-5620bd1039d2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:23.377576 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84470cbb-9605-4514-8088-5620bd1039d2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:23.378362 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84470cbb-9605-4514-8088-5620bd1039d2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:23.378506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 65/137] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:22 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:23.379772 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84470cbb-9605-4514-8088-5620bd1039d2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:23.485354 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-7dfceccf-4c15-4c05-9d11-d87fd9481e74 req-3a46e654-11b3-407c-bfd2-1cdd3cad9222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "176aa7ed-3c42-4749-852d-a397673e4e57", "name": "network-vif-plugged", "status": "completed", "tag": "2a807f69-4e6e-4e5f-9403-2f792246e051"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:23.495419 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7dfceccf-4c15-4c05-9d11-d87fd9481e74 req-3a46e654-11b3-407c-bfd2-1cdd3cad9222 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:23.496242 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7dfceccf-4c15-4c05-9d11-d87fd9481e74 req-3a46e654-11b3-407c-bfd2-1cdd3cad9222 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:23.508749 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-7dfceccf-4c15-4c05-9d11-d87fd9481e74 req-3a46e654-11b3-407c-bfd2-1cdd3cad9222 service nova] Creating event network-vif-plugged:2a807f69-4e6e-4e5f-9403-2f792246e051 for instance 176aa7ed-3c42-4749-852d-a397673e4e57 on hv-cinder-84984 Jul 31 20:00:23.517975 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-7dfceccf-4c15-4c05-9d11-d87fd9481e74 req-3a46e654-11b3-407c-bfd2-1cdd3cad9222 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033001 Jul 31 20:00:23.518848 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 66/138] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:00:23.571829 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-84470cbb-9605-4514-8088-5620bd1039d2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:23.581696 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-84470cbb-9605-4514-8088-5620bd1039d2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1367 microversion: 2.1 time: 0.220083 Jul 31 20:00:23.595409 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 73/139] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:23 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:23.729255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:23.734091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-877ac702-0e24-4e6c-8b07-3a145565082f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:23.735060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-877ac702-0e24-4e6c-8b07-3a145565082f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:23.741984 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-877ac702-0e24-4e6c-8b07-3a145565082f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:23.742709 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-877ac702-0e24-4e6c-8b07-3a145565082f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:23.744018 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-877ac702-0e24-4e6c-8b07-3a145565082f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:23.744617 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-877ac702-0e24-4e6c-8b07-3a145565082f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:23.929911 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-877ac702-0e24-4e6c-8b07-3a145565082f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:23.940383 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-877ac702-0e24-4e6c-8b07-3a145565082f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:23.941922 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-877ac702-0e24-4e6c-8b07-3a145565082f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:23.943070 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-877ac702-0e24-4e6c-8b07-3a145565082f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.214759 Jul 31 20:00:23.943695 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 67/140] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:23 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:23.989711 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-765ca049-a8d1-4448-9209-35470fb53d9d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:23.990349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-765ca049-a8d1-4448-9209-35470fb53d9d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:23.997051 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-765ca049-a8d1-4448-9209-35470fb53d9d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:23.997566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-765ca049-a8d1-4448-9209-35470fb53d9d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:23.998284 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-765ca049-a8d1-4448-9209-35470fb53d9d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:23.998789 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-765ca049-a8d1-4448-9209-35470fb53d9d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:24.156066 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-765ca049-a8d1-4448-9209-35470fb53d9d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:24.163872 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-765ca049-a8d1-4448-9209-35470fb53d9d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1500 microversion: 2.1 time: 0.178329 Jul 31 20:00:24.164513 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 74/141] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:23 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1500 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:24.290581 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5b353f8-3864-4c7f-8bde-b558ca810796 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:24.291497 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d5b353f8-3864-4c7f-8bde-b558ca810796 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:24.297701 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5b353f8-3864-4c7f-8bde-b558ca810796 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:24.298194 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5b353f8-3864-4c7f-8bde-b558ca810796 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:24.299064 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5b353f8-3864-4c7f-8bde-b558ca810796 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:24.299484 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5b353f8-3864-4c7f-8bde-b558ca810796 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:24.388837 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c7e1eeca-6540-42f2-b798-a15870a04b95 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:24.389923 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c7e1eeca-6540-42f2-b798-a15870a04b95 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:24.400947 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7e1eeca-6540-42f2-b798-a15870a04b95 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:24.402082 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7e1eeca-6540-42f2-b798-a15870a04b95 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:24.402898 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7e1eeca-6540-42f2-b798-a15870a04b95 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:24.404607 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7e1eeca-6540-42f2-b798-a15870a04b95 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:24.817891 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d5b353f8-3864-4c7f-8bde-b558ca810796 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:24.828250 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d5b353f8-3864-4c7f-8bde-b558ca810796 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1362 microversion: 2.1 time: 0.540972 Jul 31 20:00:24.842843 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 68/142] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:24 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1362 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:24.866090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a1550654-f910-4ed0-9530-5865ca5d489b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:24.866813 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a1550654-f910-4ed0-9530-5865ca5d489b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:24.878932 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1550654-f910-4ed0-9530-5865ca5d489b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:24.879344 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1550654-f910-4ed0-9530-5865ca5d489b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:24.880411 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1550654-f910-4ed0-9530-5865ca5d489b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:24.881083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1550654-f910-4ed0-9530-5865ca5d489b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:25.209456 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c7e1eeca-6540-42f2-b798-a15870a04b95 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:25.221581 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c7e1eeca-6540-42f2-b798-a15870a04b95 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.838625 Jul 31 20:00:25.234021 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 75/143] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:24 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:25.242511 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5a9c44cb-b63d-4438-95c9-3dc747cf8e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:25.243451 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5a9c44cb-b63d-4438-95c9-3dc747cf8e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:25.251571 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a9c44cb-b63d-4438-95c9-3dc747cf8e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:25.252440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a9c44cb-b63d-4438-95c9-3dc747cf8e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:25.253389 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a9c44cb-b63d-4438-95c9-3dc747cf8e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:25.254013 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a9c44cb-b63d-4438-95c9-3dc747cf8e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:25.290917 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a1550654-f910-4ed0-9530-5865ca5d489b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:25.299207 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a1550654-f910-4ed0-9530-5865ca5d489b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1367 microversion: 2.1 time: 0.454588 Jul 31 20:00:25.299790 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 69/144] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:24 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:25.457501 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5a9c44cb-b63d-4438-95c9-3dc747cf8e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:25.465707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5a9c44cb-b63d-4438-95c9-3dc747cf8e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:25.468095 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5a9c44cb-b63d-4438-95c9-3dc747cf8e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:25.469812 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5a9c44cb-b63d-4438-95c9-3dc747cf8e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.234699 Jul 31 20:00:25.470980 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 76/145] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:25 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:25.564260 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-66a12078-8601-4bf2-92f2-cc59cd457618 req-4417bc85-f24a-4aa3-9aff-db39132e44b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485", "name": "network-vif-plugged", "status": "completed", "tag": "b365ebcd-da3b-4922-a38f-6b3e66392c64"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:25.576821 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-66a12078-8601-4bf2-92f2-cc59cd457618 req-4417bc85-f24a-4aa3-9aff-db39132e44b8 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:25.577403 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-66a12078-8601-4bf2-92f2-cc59cd457618 req-4417bc85-f24a-4aa3-9aff-db39132e44b8 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:25.589648 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-66a12078-8601-4bf2-92f2-cc59cd457618 req-4417bc85-f24a-4aa3-9aff-db39132e44b8 service nova] Creating event network-vif-plugged:b365ebcd-da3b-4922-a38f-6b3e66392c64 for instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 on hv-cinder-84984 Jul 31 20:00:25.596044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-66a12078-8601-4bf2-92f2-cc59cd457618 req-4417bc85-f24a-4aa3-9aff-db39132e44b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035488 Jul 31 20:00:25.597229 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 70/146] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:00:25.730595 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-12e6d6c8-ba85-4424-b382-7a7fdc7c1aaa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aef2b39d-c372-4e76-b509-6b8488ae0f2b"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:25.733549 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-12e6d6c8-ba85-4424-b382-7a7fdc7c1aaa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:25.739947 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-12e6d6c8-ba85-4424-b382-7a7fdc7c1aaa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:25.740546 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-12e6d6c8-ba85-4424-b382-7a7fdc7c1aaa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:25.741836 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-12e6d6c8-ba85-4424-b382-7a7fdc7c1aaa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:25.742334 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-12e6d6c8-ba85-4424-b382-7a7fdc7c1aaa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:25.855507 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d7d54201-0cf0-424e-80e6-6967adb8f395 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:25.856901 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d7d54201-0cf0-424e-80e6-6967adb8f395 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:25.864092 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7d54201-0cf0-424e-80e6-6967adb8f395 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:25.873121 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7d54201-0cf0-424e-80e6-6967adb8f395 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:25.874602 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7d54201-0cf0-424e-80e6-6967adb8f395 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:25.875042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7d54201-0cf0-424e-80e6-6967adb8f395 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:26.041203 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d7d54201-0cf0-424e-80e6-6967adb8f395 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:26.050348 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d7d54201-0cf0-424e-80e6-6967adb8f395 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1362 microversion: 2.1 time: 0.199086 Jul 31 20:00:26.051419 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 71/147] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:25 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:26.245394 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b0f54588-6db4-4a3c-8c00-23068873d374 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:26.246010 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b0f54588-6db4-4a3c-8c00-23068873d374 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:26.252594 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0f54588-6db4-4a3c-8c00-23068873d374 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:26.253352 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0f54588-6db4-4a3c-8c00-23068873d374 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:26.254470 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0f54588-6db4-4a3c-8c00-23068873d374 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:26.255220 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0f54588-6db4-4a3c-8c00-23068873d374 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:26.419947 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b0f54588-6db4-4a3c-8c00-23068873d374 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:26.428245 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b0f54588-6db4-4a3c-8c00-23068873d374 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.187253 Jul 31 20:00:26.429065 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 72/148] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:26 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:26.436864 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-866f4055-7792-4e0c-ba9e-9c7b42ea3922 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:26.437897 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-866f4055-7792-4e0c-ba9e-9c7b42ea3922 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:26.440915 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:26.445053 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-866f4055-7792-4e0c-ba9e-9c7b42ea3922 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:26.445540 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-866f4055-7792-4e0c-ba9e-9c7b42ea3922 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:26.446308 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-866f4055-7792-4e0c-ba9e-9c7b42ea3922 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:26.446737 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-866f4055-7792-4e0c-ba9e-9c7b42ea3922 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:26.596756 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-866f4055-7792-4e0c-ba9e-9c7b42ea3922 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:26.604767 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-866f4055-7792-4e0c-ba9e-9c7b42ea3922 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1367 microversion: 2.1 time: 0.174533 Jul 31 20:00:26.605886 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 73/149] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:26 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:26.611992 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3a1c994b-331c-43e2-b588-234e628b3e0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:26.612947 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3a1c994b-331c-43e2-b588-234e628b3e0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:26.619475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a1c994b-331c-43e2-b588-234e628b3e0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:26.620176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a1c994b-331c-43e2-b588-234e628b3e0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:26.621024 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a1c994b-331c-43e2-b588-234e628b3e0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:26.621517 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a1c994b-331c-43e2-b588-234e628b3e0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:26.800540 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3a1c994b-331c-43e2-b588-234e628b3e0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:26.810841 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3a1c994b-331c-43e2-b588-234e628b3e0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:26.813294 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3a1c994b-331c-43e2-b588-234e628b3e0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:26.814543 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3a1c994b-331c-43e2-b588-234e628b3e0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.207407 Jul 31 20:00:26.815267 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 74/150] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:26 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:27.071691 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-83e8cff2-10eb-48e4-8058-0f9045aaa007 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:27.072567 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-83e8cff2-10eb-48e4-8058-0f9045aaa007 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:27.080173 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83e8cff2-10eb-48e4-8058-0f9045aaa007 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:27.080795 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83e8cff2-10eb-48e4-8058-0f9045aaa007 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:27.081588 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83e8cff2-10eb-48e4-8058-0f9045aaa007 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:27.082015 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83e8cff2-10eb-48e4-8058-0f9045aaa007 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:27.135042 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:27.281007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-83e8cff2-10eb-48e4-8058-0f9045aaa007 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:27.292873 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-83e8cff2-10eb-48e4-8058-0f9045aaa007 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1362 microversion: 2.1 time: 0.224880 Jul 31 20:00:27.294768 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 75/151] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:27 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:27.357772 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-12e6d6c8-ba85-4424-b382-7a7fdc7c1aaa tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "POST /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.632104 Jul 31 20:00:27.358387 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 77/152] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:00:25 2022] POST /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de/os-volume_attachments => generated 194 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:00:27.449983 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-35b98367-5bf9-4e15-91f5-44102fc199d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:27.450646 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-35b98367-5bf9-4e15-91f5-44102fc199d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:27.458169 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-35b98367-5bf9-4e15-91f5-44102fc199d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:27.458914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-35b98367-5bf9-4e15-91f5-44102fc199d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:27.460005 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-35b98367-5bf9-4e15-91f5-44102fc199d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:27.460586 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-35b98367-5bf9-4e15-91f5-44102fc199d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:27.630541 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1bae3bf4-a6c4-47e4-992d-2d77a513b2f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:27.631339 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1bae3bf4-a6c4-47e4-992d-2d77a513b2f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:27.647647 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1bae3bf4-a6c4-47e4-992d-2d77a513b2f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:27.648136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1bae3bf4-a6c4-47e4-992d-2d77a513b2f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:27.648366 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-35b98367-5bf9-4e15-91f5-44102fc199d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:27.650062 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1bae3bf4-a6c4-47e4-992d-2d77a513b2f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:27.651101 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1bae3bf4-a6c4-47e4-992d-2d77a513b2f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:27.660476 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-35b98367-5bf9-4e15-91f5-44102fc199d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.215007 Jul 31 20:00:27.679221 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 76/153] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:27 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:27.838460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6ab2d823-08a0-4dd8-8603-774dc72a316d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:27.839918 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6ab2d823-08a0-4dd8-8603-774dc72a316d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:27.857385 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ab2d823-08a0-4dd8-8603-774dc72a316d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:27.863481 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ab2d823-08a0-4dd8-8603-774dc72a316d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:27.864545 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ab2d823-08a0-4dd8-8603-774dc72a316d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:27.865208 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ab2d823-08a0-4dd8-8603-774dc72a316d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:27.898909 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:27.994404 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1bae3bf4-a6c4-47e4-992d-2d77a513b2f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:28.007968 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1bae3bf4-a6c4-47e4-992d-2d77a513b2f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1367 microversion: 2.1 time: 0.383545 Jul 31 20:00:28.009961 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 78/154] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:27 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:28.111532 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ab2d823-08a0-4dd8-8603-774dc72a316d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:28.123111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ab2d823-08a0-4dd8-8603-774dc72a316d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:28.125032 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ab2d823-08a0-4dd8-8603-774dc72a316d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:28.126448 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6ab2d823-08a0-4dd8-8603-774dc72a316d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.292212 Jul 31 20:00:28.127014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 77/155] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:27 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:28.315648 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ad4a5392-e499-4e08-b5c0-941a2211ed63 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:28.316377 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ad4a5392-e499-4e08-b5c0-941a2211ed63 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:28.323087 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad4a5392-e499-4e08-b5c0-941a2211ed63 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:28.323801 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad4a5392-e499-4e08-b5c0-941a2211ed63 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:28.324765 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad4a5392-e499-4e08-b5c0-941a2211ed63 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:28.325676 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad4a5392-e499-4e08-b5c0-941a2211ed63 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:28.556453 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ad4a5392-e499-4e08-b5c0-941a2211ed63 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:28.569588 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-5728deb8-c6ba-4eec-9f2a-0a6d4f01dcfb req-ebf9e461-7c22-4372-a7b7-26614a4070dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb0b91c-9a78-49a1-a96b-016c09759655", "name": "network-vif-plugged", "status": "completed", "tag": "eaea7f4e-af98-4acb-9edb-366b7b6e28d8"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:28.570098 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ad4a5392-e499-4e08-b5c0-941a2211ed63 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1362 microversion: 2.1 time: 0.252827 Jul 31 20:00:28.570320 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 79/156] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:28 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:28.585880 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5728deb8-c6ba-4eec-9f2a-0a6d4f01dcfb req-ebf9e461-7c22-4372-a7b7-26614a4070dc service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:28.588173 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5728deb8-c6ba-4eec-9f2a-0a6d4f01dcfb req-ebf9e461-7c22-4372-a7b7-26614a4070dc service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:28.608337 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-5728deb8-c6ba-4eec-9f2a-0a6d4f01dcfb req-ebf9e461-7c22-4372-a7b7-26614a4070dc service nova] Creating event network-vif-plugged:eaea7f4e-af98-4acb-9edb-366b7b6e28d8 for instance cdb0b91c-9a78-49a1-a96b-016c09759655 on hv-cinder-84984 Jul 31 20:00:28.614471 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-5728deb8-c6ba-4eec-9f2a-0a6d4f01dcfb req-ebf9e461-7c22-4372-a7b7-26614a4070dc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048790 Jul 31 20:00:28.615362 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 78/157] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:00:28.683909 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-de64b8bd-2707-4b3f-bfaa-d316d36caa9c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:28.684654 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-de64b8bd-2707-4b3f-bfaa-d316d36caa9c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:28.692476 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de64b8bd-2707-4b3f-bfaa-d316d36caa9c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:28.693769 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de64b8bd-2707-4b3f-bfaa-d316d36caa9c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:28.695853 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de64b8bd-2707-4b3f-bfaa-d316d36caa9c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:28.696489 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de64b8bd-2707-4b3f-bfaa-d316d36caa9c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:28.927527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-de64b8bd-2707-4b3f-bfaa-d316d36caa9c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:28.954530 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-de64b8bd-2707-4b3f-bfaa-d316d36caa9c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.273225 Jul 31 20:00:28.957417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 80/158] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:28 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:29.032215 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a5957dbf-aa41-4d8e-bd4b-25313e661c3d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:29.033454 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a5957dbf-aa41-4d8e-bd4b-25313e661c3d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:29.043328 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5957dbf-aa41-4d8e-bd4b-25313e661c3d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:29.044036 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5957dbf-aa41-4d8e-bd4b-25313e661c3d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:29.044798 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5957dbf-aa41-4d8e-bd4b-25313e661c3d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:29.045424 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5957dbf-aa41-4d8e-bd4b-25313e661c3d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:29.153080 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6cf4cb47-93c1-4bee-9db9-8e49ecee41cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:29.154434 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6cf4cb47-93c1-4bee-9db9-8e49ecee41cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:29.164418 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6cf4cb47-93c1-4bee-9db9-8e49ecee41cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:29.165489 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6cf4cb47-93c1-4bee-9db9-8e49ecee41cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:29.166529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6cf4cb47-93c1-4bee-9db9-8e49ecee41cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:29.167801 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6cf4cb47-93c1-4bee-9db9-8e49ecee41cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:29.325401 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a5957dbf-aa41-4d8e-bd4b-25313e661c3d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:29.334031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a5957dbf-aa41-4d8e-bd4b-25313e661c3d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1557 microversion: 2.1 time: 0.307705 Jul 31 20:00:29.334815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 79/159] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:29 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1557 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:29.358005 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-70ea7eab-3f2c-47da-9003-1f0fe6f7efea tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:29.358817 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-70ea7eab-3f2c-47da-9003-1f0fe6f7efea tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:29.373622 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70ea7eab-3f2c-47da-9003-1f0fe6f7efea tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:29.374326 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70ea7eab-3f2c-47da-9003-1f0fe6f7efea tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:29.375461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70ea7eab-3f2c-47da-9003-1f0fe6f7efea tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:29.376959 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70ea7eab-3f2c-47da-9003-1f0fe6f7efea tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:29.499524 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6cf4cb47-93c1-4bee-9db9-8e49ecee41cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:29.510227 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6cf4cb47-93c1-4bee-9db9-8e49ecee41cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:29.512289 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6cf4cb47-93c1-4bee-9db9-8e49ecee41cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:29.514544 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6cf4cb47-93c1-4bee-9db9-8e49ecee41cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.367332 Jul 31 20:00:29.527736 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 81/160] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:29 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:29.558522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-70ea7eab-3f2c-47da-9003-1f0fe6f7efea tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204439 Jul 31 20:00:29.559556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 80/161] 10.222.0.48 () {58 vars in 1275 bytes} [Sun Jul 31 20:00:29 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:00:29.590259 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-252d6cee-26cf-4c5a-a0e9-152d165e5458 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:29.590794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-252d6cee-26cf-4c5a-a0e9-152d165e5458 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:29.597040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-252d6cee-26cf-4c5a-a0e9-152d165e5458 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:29.597512 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-252d6cee-26cf-4c5a-a0e9-152d165e5458 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:29.598280 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-252d6cee-26cf-4c5a-a0e9-152d165e5458 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:29.598704 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-252d6cee-26cf-4c5a-a0e9-152d165e5458 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:29.776292 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-252d6cee-26cf-4c5a-a0e9-152d165e5458 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:29.786949 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-252d6cee-26cf-4c5a-a0e9-152d165e5458 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1548 microversion: 2.1 time: 0.200443 Jul 31 20:00:29.788258 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 82/162] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:29 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1548 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:29.814383 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ab4cc79a-6f20-4e2b-9e44-45d61716dbc5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:29.815262 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ab4cc79a-6f20-4e2b-9e44-45d61716dbc5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:29.822994 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab4cc79a-6f20-4e2b-9e44-45d61716dbc5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:29.823526 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab4cc79a-6f20-4e2b-9e44-45d61716dbc5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:29.824394 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab4cc79a-6f20-4e2b-9e44-45d61716dbc5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:29.824971 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab4cc79a-6f20-4e2b-9e44-45d61716dbc5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:29.913345 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ab4cc79a-6f20-4e2b-9e44-45d61716dbc5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103379 Jul 31 20:00:29.913989 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 81/163] 10.222.0.48 () {58 vars in 1275 bytes} [Sun Jul 31 20:00:29 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:00:29.978235 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b03147ee-00ae-4eba-93f5-ac9636dd2733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:29.978986 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b03147ee-00ae-4eba-93f5-ac9636dd2733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:29.986742 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b03147ee-00ae-4eba-93f5-ac9636dd2733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:29.987523 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b03147ee-00ae-4eba-93f5-ac9636dd2733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:29.988522 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b03147ee-00ae-4eba-93f5-ac9636dd2733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:29.989193 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b03147ee-00ae-4eba-93f5-ac9636dd2733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:30.315986 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b03147ee-00ae-4eba-93f5-ac9636dd2733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:30.331071 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b03147ee-00ae-4eba-93f5-ac9636dd2733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.357075 Jul 31 20:00:30.332640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 83/164] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:29 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:30.551684 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-35ac88cb-1fc4-4952-8117-6e19636e40b5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:30.553795 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-35ac88cb-1fc4-4952-8117-6e19636e40b5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:30.572356 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-35ac88cb-1fc4-4952-8117-6e19636e40b5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:30.577462 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-35ac88cb-1fc4-4952-8117-6e19636e40b5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:30.578589 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-35ac88cb-1fc4-4952-8117-6e19636e40b5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:30.580272 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-35ac88cb-1fc4-4952-8117-6e19636e40b5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:30.666819 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-c9f725e2-702d-4ac7-b934-77242dde1c2d req-d9fe96ad-dcd5-4e2a-898d-150accb962af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a098dc51-df70-4d1b-ae0b-264fdb83e932", "name": "network-vif-plugged", "status": "completed", "tag": "95267dcb-4338-43ed-96fe-5c4a8c8ee0dd"}, {"server_uuid": "8ecd0dfe-455d-48b5-bae6-6f0544738769", "name": "network-vif-plugged", "status": "completed", "tag": "cfa02dcb-7408-495e-8b94-f4b8c7c96142"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:30.685445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-c9f725e2-702d-4ac7-b934-77242dde1c2d req-d9fe96ad-dcd5-4e2a-898d-150accb962af service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:30.685926 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-c9f725e2-702d-4ac7-b934-77242dde1c2d req-d9fe96ad-dcd5-4e2a-898d-150accb962af service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:30.715468 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-c9f725e2-702d-4ac7-b934-77242dde1c2d req-d9fe96ad-dcd5-4e2a-898d-150accb962af service nova] Creating event network-vif-plugged:95267dcb-4338-43ed-96fe-5c4a8c8ee0dd for instance a098dc51-df70-4d1b-ae0b-264fdb83e932 on hv-cinder-84984 Jul 31 20:00:30.717346 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-c9f725e2-702d-4ac7-b934-77242dde1c2d req-d9fe96ad-dcd5-4e2a-898d-150accb962af service nova] Creating event network-vif-plugged:cfa02dcb-7408-495e-8b94-f4b8c7c96142 for instance 8ecd0dfe-455d-48b5-bae6-6f0544738769 on hv-cinder-84984 Jul 31 20:00:30.729399 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-c9f725e2-702d-4ac7-b934-77242dde1c2d req-d9fe96ad-dcd5-4e2a-898d-150accb962af service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067147 Jul 31 20:00:30.736760 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 84/165] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:00:31.126484 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-35ac88cb-1fc4-4952-8117-6e19636e40b5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:31.141853 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-35ac88cb-1fc4-4952-8117-6e19636e40b5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:31.143363 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-35ac88cb-1fc4-4952-8117-6e19636e40b5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:31.144462 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-35ac88cb-1fc4-4952-8117-6e19636e40b5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.607294 Jul 31 20:00:31.145018 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 82/166] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:30 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:31.358860 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-246bd639-8707-4a35-9095-8f7c462f57f4 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:31.360064 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-246bd639-8707-4a35-9095-8f7c462f57f4 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:31.367264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-246bd639-8707-4a35-9095-8f7c462f57f4 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:31.367917 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-246bd639-8707-4a35-9095-8f7c462f57f4 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:31.369321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-246bd639-8707-4a35-9095-8f7c462f57f4 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:31.369928 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-246bd639-8707-4a35-9095-8f7c462f57f4 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:31.855531 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-246bd639-8707-4a35-9095-8f7c462f57f4 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:31.873784 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-246bd639-8707-4a35-9095-8f7c462f57f4 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.524222 Jul 31 20:00:31.901120 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 85/167] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:31 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:31.984547 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1f9774a2-4414-48fe-b71e-f5683079eca9 req-402f92b2-1621-4a78-ad88-188d3be98753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "176aa7ed-3c42-4749-852d-a397673e4e57", "tag": "2a807f69-4e6e-4e5f-9403-2f792246e051"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:31.996600 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1f9774a2-4414-48fe-b71e-f5683079eca9 req-402f92b2-1621-4a78-ad88-188d3be98753 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:31.997236 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1f9774a2-4414-48fe-b71e-f5683079eca9 req-402f92b2-1621-4a78-ad88-188d3be98753 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:32.011323 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1f9774a2-4414-48fe-b71e-f5683079eca9 req-402f92b2-1621-4a78-ad88-188d3be98753 service nova] Creating event network-changed:2a807f69-4e6e-4e5f-9403-2f792246e051 for instance 176aa7ed-3c42-4749-852d-a397673e4e57 on hv-cinder-84984 Jul 31 20:00:32.016837 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1f9774a2-4414-48fe-b71e-f5683079eca9 req-402f92b2-1621-4a78-ad88-188d3be98753 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035984 Jul 31 20:00:32.018224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 83/168] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:00:32.168074 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f526cd9f-e109-43c8-935f-7985ba4f0d2e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:32.168916 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f526cd9f-e109-43c8-935f-7985ba4f0d2e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:32.177405 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f526cd9f-e109-43c8-935f-7985ba4f0d2e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:32.178915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f526cd9f-e109-43c8-935f-7985ba4f0d2e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:32.185225 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f526cd9f-e109-43c8-935f-7985ba4f0d2e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:32.187598 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f526cd9f-e109-43c8-935f-7985ba4f0d2e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:32.415134 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-d1e40e91-4c39-403a-bed6-b3bbf3167e31 req-dbd283a9-65f7-4cba-8c7c-517b0dd9a3df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485", "tag": "b365ebcd-da3b-4922-a38f-6b3e66392c64"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:32.434702 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f526cd9f-e109-43c8-935f-7985ba4f0d2e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:32.445898 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d1e40e91-4c39-403a-bed6-b3bbf3167e31 req-dbd283a9-65f7-4cba-8c7c-517b0dd9a3df service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:32.446340 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d1e40e91-4c39-403a-bed6-b3bbf3167e31 req-dbd283a9-65f7-4cba-8c7c-517b0dd9a3df service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:32.455328 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f526cd9f-e109-43c8-935f-7985ba4f0d2e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:32.458728 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f526cd9f-e109-43c8-935f-7985ba4f0d2e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:32.460912 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f526cd9f-e109-43c8-935f-7985ba4f0d2e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1405 microversion: 2.20 time: 0.298043 Jul 31 20:00:32.461881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-d1e40e91-4c39-403a-bed6-b3bbf3167e31 req-dbd283a9-65f7-4cba-8c7c-517b0dd9a3df service nova] Creating event network-changed:b365ebcd-da3b-4922-a38f-6b3e66392c64 for instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 on hv-cinder-84984 Jul 31 20:00:32.462074 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 86/169] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:32 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1405 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:32.467377 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-d1e40e91-4c39-403a-bed6-b3bbf3167e31 req-dbd283a9-65f7-4cba-8c7c-517b0dd9a3df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058177 Jul 31 20:00:32.468119 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 84/170] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:00:32.899986 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1e5347c8-ff05-4675-a9ce-f6a4913cc112 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:32.901745 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1e5347c8-ff05-4675-a9ce-f6a4913cc112 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:32.910810 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e5347c8-ff05-4675-a9ce-f6a4913cc112 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:32.911560 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e5347c8-ff05-4675-a9ce-f6a4913cc112 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:32.912699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e5347c8-ff05-4675-a9ce-f6a4913cc112 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:32.913133 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e5347c8-ff05-4675-a9ce-f6a4913cc112 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:33.180046 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1e5347c8-ff05-4675-a9ce-f6a4913cc112 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:33.195206 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1e5347c8-ff05-4675-a9ce-f6a4913cc112 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.301290 Jul 31 20:00:33.196406 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 87/171] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:32 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:33.487329 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-501882f2-bcb3-4de4-9711-20c7499d221e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:33.488225 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-501882f2-bcb3-4de4-9711-20c7499d221e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:33.500000 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-501882f2-bcb3-4de4-9711-20c7499d221e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:33.505430 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-501882f2-bcb3-4de4-9711-20c7499d221e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:33.506375 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-501882f2-bcb3-4de4-9711-20c7499d221e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:33.507041 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-501882f2-bcb3-4de4-9711-20c7499d221e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:33.779520 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-501882f2-bcb3-4de4-9711-20c7499d221e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:33.800026 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-501882f2-bcb3-4de4-9711-20c7499d221e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:33.801709 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-501882f2-bcb3-4de4-9711-20c7499d221e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:33.803298 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-501882f2-bcb3-4de4-9711-20c7499d221e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1598 microversion: 2.20 time: 0.321263 Jul 31 20:00:33.804583 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 85/172] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:00:33 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1598 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:00:33.827638 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6a828886-9efb-4b3a-8b7e-5710f383c3f7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:33.828217 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6a828886-9efb-4b3a-8b7e-5710f383c3f7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:33.838789 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6a828886-9efb-4b3a-8b7e-5710f383c3f7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:33.838789 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6a828886-9efb-4b3a-8b7e-5710f383c3f7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:33.839247 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6a828886-9efb-4b3a-8b7e-5710f383c3f7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:33.841948 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6a828886-9efb-4b3a-8b7e-5710f383c3f7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:33.993005 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6a828886-9efb-4b3a-8b7e-5710f383c3f7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.169953 Jul 31 20:00:33.994032 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 88/173] 10.222.0.48 () {60 vars in 1316 bytes} [Sun Jul 31 20:00:33 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 20:00:34.218175 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fc31e7a5-d7a4-4d68-8e95-66d05c9cbb0e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:34.219158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fc31e7a5-d7a4-4d68-8e95-66d05c9cbb0e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:34.231376 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc31e7a5-d7a4-4d68-8e95-66d05c9cbb0e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:34.231803 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc31e7a5-d7a4-4d68-8e95-66d05c9cbb0e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:34.232586 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc31e7a5-d7a4-4d68-8e95-66d05c9cbb0e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:34.233014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc31e7a5-d7a4-4d68-8e95-66d05c9cbb0e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:34.423600 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fc31e7a5-d7a4-4d68-8e95-66d05c9cbb0e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:34.437126 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fc31e7a5-d7a4-4d68-8e95-66d05c9cbb0e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1321 microversion: 2.1 time: 0.224587 Jul 31 20:00:34.438384 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 86/174] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:34 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:35.256590 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-df2fb111-8562-4f25-bccc-d3c74f35d520 req-6dbf5063-3853-49e3-951c-162adf254881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb0b91c-9a78-49a1-a96b-016c09759655", "tag": "eaea7f4e-af98-4acb-9edb-366b7b6e28d8"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:35.269950 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-df2fb111-8562-4f25-bccc-d3c74f35d520 req-6dbf5063-3853-49e3-951c-162adf254881 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:35.270454 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-df2fb111-8562-4f25-bccc-d3c74f35d520 req-6dbf5063-3853-49e3-951c-162adf254881 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:35.282417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-df2fb111-8562-4f25-bccc-d3c74f35d520 req-6dbf5063-3853-49e3-951c-162adf254881 service nova] Creating event network-changed:eaea7f4e-af98-4acb-9edb-366b7b6e28d8 for instance cdb0b91c-9a78-49a1-a96b-016c09759655 on hv-cinder-84984 Jul 31 20:00:35.287652 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-df2fb111-8562-4f25-bccc-d3c74f35d520 req-6dbf5063-3853-49e3-951c-162adf254881 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037462 Jul 31 20:00:35.288821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 89/175] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:00:35.459018 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7a2f4339-fda7-4568-a6f6-986222e20dbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:35.460321 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7a2f4339-fda7-4568-a6f6-986222e20dbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:35.466754 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a2f4339-fda7-4568-a6f6-986222e20dbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:35.467203 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a2f4339-fda7-4568-a6f6-986222e20dbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:35.468001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a2f4339-fda7-4568-a6f6-986222e20dbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:35.468400 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a2f4339-fda7-4568-a6f6-986222e20dbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:36.020883 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7a2f4339-fda7-4568-a6f6-986222e20dbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:36.040916 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7a2f4339-fda7-4568-a6f6-986222e20dbe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1515 microversion: 2.1 time: 0.585517 Jul 31 20:00:36.041036 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 87/176] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:35 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1515 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:36.068455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-447e13cd-39bb-45d8-8544-ea0b661f7e29 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:36.070783 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-447e13cd-39bb-45d8-8544-ea0b661f7e29 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:36.083985 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-447e13cd-39bb-45d8-8544-ea0b661f7e29 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:36.084443 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-447e13cd-39bb-45d8-8544-ea0b661f7e29 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:36.085195 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-447e13cd-39bb-45d8-8544-ea0b661f7e29 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:36.085617 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-447e13cd-39bb-45d8-8544-ea0b661f7e29 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:36.115959 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-447e13cd-39bb-45d8-8544-ea0b661f7e29 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lazy-loading 'flavor' on Instance uuid 8ecd0dfe-455d-48b5-bae6-6f0544738769 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:00:36.235902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-447e13cd-39bb-45d8-8544-ea0b661f7e29 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "POST /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769/action" status: 200 len: 32 microversion: 2.1 time: 0.172828 Jul 31 20:00:36.241185 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 90/177] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:00:36 2022] POST /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 31 20:00:36.246718 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eae5b9c5-3548-4d30-b268-00b4540ad2cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:36.247319 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eae5b9c5-3548-4d30-b268-00b4540ad2cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:36.254888 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eae5b9c5-3548-4d30-b268-00b4540ad2cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:36.255367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eae5b9c5-3548-4d30-b268-00b4540ad2cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:36.256173 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eae5b9c5-3548-4d30-b268-00b4540ad2cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:36.257059 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eae5b9c5-3548-4d30-b268-00b4540ad2cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:36.441921 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eae5b9c5-3548-4d30-b268-00b4540ad2cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:36.450153 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eae5b9c5-3548-4d30-b268-00b4540ad2cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.207679 Jul 31 20:00:36.455654 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 88/178] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:36 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:37.481471 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-39293326-75ac-47b5-9072-4bcdf193fad2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:37.482165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-39293326-75ac-47b5-9072-4bcdf193fad2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:37.490561 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39293326-75ac-47b5-9072-4bcdf193fad2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:37.491011 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39293326-75ac-47b5-9072-4bcdf193fad2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:37.492048 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39293326-75ac-47b5-9072-4bcdf193fad2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:37.492481 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39293326-75ac-47b5-9072-4bcdf193fad2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:37.624377 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-39293326-75ac-47b5-9072-4bcdf193fad2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:37.632250 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-39293326-75ac-47b5-9072-4bcdf193fad2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.156279 Jul 31 20:00:37.632849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 91/179] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:37 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:38.653435 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f93a1672-164f-4276-846b-9eb3baa825f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:38.654063 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f93a1672-164f-4276-846b-9eb3baa825f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:38.660410 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f93a1672-164f-4276-846b-9eb3baa825f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:38.660848 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f93a1672-164f-4276-846b-9eb3baa825f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:38.661639 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f93a1672-164f-4276-846b-9eb3baa825f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:38.662062 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f93a1672-164f-4276-846b-9eb3baa825f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:38.791311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f93a1672-164f-4276-846b-9eb3baa825f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:38.799076 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f93a1672-164f-4276-846b-9eb3baa825f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.149693 Jul 31 20:00:38.799648 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 89/180] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:38 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:39.819187 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-180d724f-4575-4cb3-8f89-72ae58f98784 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:39.819790 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-180d724f-4575-4cb3-8f89-72ae58f98784 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:39.826596 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-180d724f-4575-4cb3-8f89-72ae58f98784 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:39.827054 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-180d724f-4575-4cb3-8f89-72ae58f98784 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:39.827809 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-180d724f-4575-4cb3-8f89-72ae58f98784 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:39.828238 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-180d724f-4575-4cb3-8f89-72ae58f98784 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:39.971018 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-180d724f-4575-4cb3-8f89-72ae58f98784 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:39.978718 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-180d724f-4575-4cb3-8f89-72ae58f98784 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.163364 Jul 31 20:00:39.979286 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 92/181] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:39 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:40.999147 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c0db3d8b-557c-452d-b2ce-8bfb60945adb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:41.000441 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c0db3d8b-557c-452d-b2ce-8bfb60945adb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:41.008627 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0db3d8b-557c-452d-b2ce-8bfb60945adb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:41.009419 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0db3d8b-557c-452d-b2ce-8bfb60945adb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:41.010656 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0db3d8b-557c-452d-b2ce-8bfb60945adb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:41.011051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0db3d8b-557c-452d-b2ce-8bfb60945adb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:41.156350 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c0db3d8b-557c-452d-b2ce-8bfb60945adb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:41.168200 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c0db3d8b-557c-452d-b2ce-8bfb60945adb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.172509 Jul 31 20:00:41.168941 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 90/182] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:40 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:42.190751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d226655e-3849-4e9e-b5fd-58c46d4b8813 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:42.191375 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d226655e-3849-4e9e-b5fd-58c46d4b8813 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:42.198057 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d226655e-3849-4e9e-b5fd-58c46d4b8813 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:42.198501 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d226655e-3849-4e9e-b5fd-58c46d4b8813 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:42.199276 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d226655e-3849-4e9e-b5fd-58c46d4b8813 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:42.199695 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d226655e-3849-4e9e-b5fd-58c46d4b8813 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:42.203755 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:42.341463 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d226655e-3849-4e9e-b5fd-58c46d4b8813 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:42.349017 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d226655e-3849-4e9e-b5fd-58c46d4b8813 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.162188 Jul 31 20:00:42.349794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 93/183] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:42 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:43.370914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b16f77b3-3b5c-4391-9c42-c7b23b571236 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:43.372422 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b16f77b3-3b5c-4391-9c42-c7b23b571236 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:43.379903 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b16f77b3-3b5c-4391-9c42-c7b23b571236 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:43.380643 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b16f77b3-3b5c-4391-9c42-c7b23b571236 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:43.381758 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b16f77b3-3b5c-4391-9c42-c7b23b571236 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:43.382187 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b16f77b3-3b5c-4391-9c42-c7b23b571236 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:43.897652 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-63672472-e58b-4e48-9695-1356bc75ee40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:43.898215 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-63672472-e58b-4e48-9695-1356bc75ee40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:43.905024 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63672472-e58b-4e48-9695-1356bc75ee40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:43.905492 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63672472-e58b-4e48-9695-1356bc75ee40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:43.906324 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63672472-e58b-4e48-9695-1356bc75ee40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:43.906917 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63672472-e58b-4e48-9695-1356bc75ee40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:43.943212 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-63672472-e58b-4e48-9695-1356bc75ee40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:00:44.065138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-63672472-e58b-4e48-9695-1356bc75ee40 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 204 len: 0 microversion: 2.1 time: 0.171004 Jul 31 20:00:44.067369 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 94/184] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:00:43 2022] DELETE /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 20:00:44.078565 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5a490e34-7f63-4d8c-9e84-49f0470e7bdb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:44.079490 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5a490e34-7f63-4d8c-9e84-49f0470e7bdb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:44.094020 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a490e34-7f63-4d8c-9e84-49f0470e7bdb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:44.096073 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a490e34-7f63-4d8c-9e84-49f0470e7bdb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:44.098356 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a490e34-7f63-4d8c-9e84-49f0470e7bdb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:44.100570 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a490e34-7f63-4d8c-9e84-49f0470e7bdb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:44.112815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b16f77b3-3b5c-4391-9c42-c7b23b571236 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:44.120744 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b16f77b3-3b5c-4391-9c42-c7b23b571236 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.754694 Jul 31 20:00:44.124226 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 91/185] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:43 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:44.265870 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5a490e34-7f63-4d8c-9e84-49f0470e7bdb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:44.274626 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5a490e34-7f63-4d8c-9e84-49f0470e7bdb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1552 microversion: 2.1 time: 0.202627 Jul 31 20:00:44.275200 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 95/186] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:44 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1552 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:45.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fecadcbe-6152-4ec7-8b44-ecee4d53a152 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:45.150491 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fecadcbe-6152-4ec7-8b44-ecee4d53a152 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:45.159908 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fecadcbe-6152-4ec7-8b44-ecee4d53a152 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:45.160355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fecadcbe-6152-4ec7-8b44-ecee4d53a152 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:45.161099 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fecadcbe-6152-4ec7-8b44-ecee4d53a152 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:45.161550 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fecadcbe-6152-4ec7-8b44-ecee4d53a152 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:45.295543 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cfe2d17e-0319-4cf3-ba43-0c7169765075 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:45.296128 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cfe2d17e-0319-4cf3-ba43-0c7169765075 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:45.303273 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfe2d17e-0319-4cf3-ba43-0c7169765075 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:45.304252 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfe2d17e-0319-4cf3-ba43-0c7169765075 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:45.305063 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfe2d17e-0319-4cf3-ba43-0c7169765075 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:45.305533 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfe2d17e-0319-4cf3-ba43-0c7169765075 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:45.306813 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fecadcbe-6152-4ec7-8b44-ecee4d53a152 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:45.315514 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fecadcbe-6152-4ec7-8b44-ecee4d53a152 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.172428 Jul 31 20:00:45.316093 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 92/187] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:45 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:45.439159 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cfe2d17e-0319-4cf3-ba43-0c7169765075 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:45.447392 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cfe2d17e-0319-4cf3-ba43-0c7169765075 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1552 microversion: 2.1 time: 0.155989 Jul 31 20:00:45.447965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 96/188] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:45 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:46.340632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-19645132-1110-479f-a99f-c5f20b243756 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:46.341702 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-19645132-1110-479f-a99f-c5f20b243756 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:46.361540 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19645132-1110-479f-a99f-c5f20b243756 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:46.362040 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19645132-1110-479f-a99f-c5f20b243756 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:46.362801 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19645132-1110-479f-a99f-c5f20b243756 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:46.363323 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19645132-1110-479f-a99f-c5f20b243756 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:46.468924 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6bcc24bd-d57f-4b08-a4d8-063c12cbe805 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:46.469644 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6bcc24bd-d57f-4b08-a4d8-063c12cbe805 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:46.476611 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6bcc24bd-d57f-4b08-a4d8-063c12cbe805 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:46.477120 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6bcc24bd-d57f-4b08-a4d8-063c12cbe805 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:46.477855 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6bcc24bd-d57f-4b08-a4d8-063c12cbe805 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:46.478280 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6bcc24bd-d57f-4b08-a4d8-063c12cbe805 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:46.501658 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-19645132-1110-479f-a99f-c5f20b243756 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:46.509334 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-19645132-1110-479f-a99f-c5f20b243756 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.175336 Jul 31 20:00:46.509916 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 93/189] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:46 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:46.622823 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6bcc24bd-d57f-4b08-a4d8-063c12cbe805 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:46.631358 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6bcc24bd-d57f-4b08-a4d8-063c12cbe805 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1552 microversion: 2.1 time: 0.166733 Jul 31 20:00:46.632025 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 97/190] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:46 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:47.533063 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c04bc5ac-5491-4ce0-a6c4-8040bf8b9b36 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:47.533891 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c04bc5ac-5491-4ce0-a6c4-8040bf8b9b36 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:47.542114 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c04bc5ac-5491-4ce0-a6c4-8040bf8b9b36 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:47.542574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c04bc5ac-5491-4ce0-a6c4-8040bf8b9b36 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:47.543688 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c04bc5ac-5491-4ce0-a6c4-8040bf8b9b36 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:47.544274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c04bc5ac-5491-4ce0-a6c4-8040bf8b9b36 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:47.651860 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fcaf3d2b-2b7f-4e74-8f9c-c99845d7b542 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:47.653090 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fcaf3d2b-2b7f-4e74-8f9c-c99845d7b542 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:47.659849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcaf3d2b-2b7f-4e74-8f9c-c99845d7b542 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:47.660448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcaf3d2b-2b7f-4e74-8f9c-c99845d7b542 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:47.661428 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcaf3d2b-2b7f-4e74-8f9c-c99845d7b542 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:47.661998 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcaf3d2b-2b7f-4e74-8f9c-c99845d7b542 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:47.911958 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c04bc5ac-5491-4ce0-a6c4-8040bf8b9b36 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:47.921863 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c04bc5ac-5491-4ce0-a6c4-8040bf8b9b36 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.394395 Jul 31 20:00:47.937915 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 94/191] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:47 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:48.026400 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fcaf3d2b-2b7f-4e74-8f9c-c99845d7b542 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:48.036139 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fcaf3d2b-2b7f-4e74-8f9c-c99845d7b542 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1552 microversion: 2.1 time: 0.387983 Jul 31 20:00:48.041044 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 98/192] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:47 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1552 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:48.289707 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-f18d6857-020f-4515-8f76-31821b29ac85 req-e457d7de-c600-4497-9301-6007d7827aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef21f87f-e509-4c7d-883c-3e0f5d0672de", "name": "network-vif-deleted", "tag": "a4ca66a2-1746-449b-8904-3d6445d22f14"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:48.304364 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f18d6857-020f-4515-8f76-31821b29ac85 req-e457d7de-c600-4497-9301-6007d7827aed service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:48.305304 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f18d6857-020f-4515-8f76-31821b29ac85 req-e457d7de-c600-4497-9301-6007d7827aed service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:48.344873 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-f18d6857-020f-4515-8f76-31821b29ac85 req-e457d7de-c600-4497-9301-6007d7827aed service nova] Creating event network-vif-deleted:a4ca66a2-1746-449b-8904-3d6445d22f14 for instance ef21f87f-e509-4c7d-883c-3e0f5d0672de on hv-cinder-84984 Jul 31 20:00:48.354860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-f18d6857-020f-4515-8f76-31821b29ac85 req-e457d7de-c600-4497-9301-6007d7827aed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070740 Jul 31 20:00:48.355737 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 95/193] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:00:48.945683 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-26432006-a7fc-4ad4-adf8-92b0ec54c879 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:48.946317 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-26432006-a7fc-4ad4-adf8-92b0ec54c879 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:48.954671 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-26432006-a7fc-4ad4-adf8-92b0ec54c879 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:48.955143 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-26432006-a7fc-4ad4-adf8-92b0ec54c879 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:48.956096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-26432006-a7fc-4ad4-adf8-92b0ec54c879 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:48.956552 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-26432006-a7fc-4ad4-adf8-92b0ec54c879 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:49.063385 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4e0eb009-18b2-4aeb-adbb-223a56768b0d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:49.064069 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4e0eb009-18b2-4aeb-adbb-223a56768b0d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:49.072136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e0eb009-18b2-4aeb-adbb-223a56768b0d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:49.072832 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e0eb009-18b2-4aeb-adbb-223a56768b0d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:49.074163 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e0eb009-18b2-4aeb-adbb-223a56768b0d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:49.074780 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e0eb009-18b2-4aeb-adbb-223a56768b0d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:49.111709 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e0eb009-18b2-4aeb-adbb-223a56768b0d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:49.112344 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e0eb009-18b2-4aeb-adbb-223a56768b0d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:49.112827 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-4e0eb009-18b2-4aeb-adbb-223a56768b0d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lazy-loading 'fault' on Instance uuid ef21f87f-e509-4c7d-883c-3e0f5d0672de {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:00:49.193442 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4e0eb009-18b2-4aeb-adbb-223a56768b0d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ae686b7ff04508a6cfb6723f5d0f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac9cd175c5b423389779d2f4f487287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:49.203841 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4e0eb009-18b2-4aeb-adbb-223a56768b0d tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 200 len: 1350 microversion: 2.1 time: 0.144673 Jul 31 20:00:49.204429 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 96/194] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:49 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:49.213483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-26432006-a7fc-4ad4-adf8-92b0ec54c879 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:49.222230 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-26432006-a7fc-4ad4-adf8-92b0ec54c879 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.280484 Jul 31 20:00:49.223081 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 99/195] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:48 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:50.224651 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65eb8a1b-6590-45bb-a7fb-ea4210cac219 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:50.225396 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-65eb8a1b-6590-45bb-a7fb-ea4210cac219 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:50.231604 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65eb8a1b-6590-45bb-a7fb-ea4210cac219 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:50.232033 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65eb8a1b-6590-45bb-a7fb-ea4210cac219 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:50.233075 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65eb8a1b-6590-45bb-a7fb-ea4210cac219 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:50.233522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65eb8a1b-6590-45bb-a7fb-ea4210cac219 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:50.237623 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:50.248028 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-27630d10-ea46-4ea2-a29c-d5796e36a75e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:50.248749 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-65eb8a1b-6590-45bb-a7fb-ea4210cac219 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] HTTP exception thrown: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:50.249009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-27630d10-ea46-4ea2-a29c-d5796e36a75e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65eb8a1b-6590-45bb-a7fb-ea4210cac219 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Request method failure captured: Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de HTTP/1.1 Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8zQ9G7AVbGuMJYPKDoOr0T33mKTIQonwfeDDR82nhCPPKOMSCJqT6sJKADjmW8dqWWPXA03HJpWk4zjlH7qr_ZNUKrMy3cPnWFVXbmBKpAlbkqFaRDf7ktszFhtUmBGr2WBPOpIKV9KTUGu9Tny1rmLSUTvrDvKGirH00VP-q5E5g Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 7ac9cd175c5b423389779d2f4f487287 Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-DeleteServersTestJSON-1078827501 Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:00:50.253961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:00:50.255477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ac9cd175c5b423389779d2f4f487287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ac9cd175c5b423389779d2f4f487287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ac9cd175c5b423389779d2f4f487287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ac9cd175c5b423389779d2f4f487287"}]}] Jul 31 20:00:50.255477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-DeleteServersTestJSON-1078827501 Jul 31 20:00:50.255477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7ac9cd175c5b423389779d2f4f487287 Jul 31 20:00:50.255477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1078827501 Jul 31 20:00:50.255477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-DeleteServersTestJSON-1078827501-project Jul 31 20:00:50.255477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:00:50.255477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:00:50.255477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 40ae686b7ff04508a6cfb6723f5d0f70 Jul 31 20:00:50.255477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-DeleteServersTestJSON-1078827501-project Jul 31 20:00:50.255477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:00:50.255477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:50.255477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': 'ef21f87f-e509-4c7d-883c-3e0f5d0672de'} Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:00:50.256327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:50.257725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:50.258841 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65eb8a1b-6590-45bb-a7fb-ea4210cac219 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Returning 404 to user: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:00:50.258841 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-65eb8a1b-6590-45bb-a7fb-ea4210cac219 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 404 len: 111 microversion: 2.1 time: 0.034805 Jul 31 20:00:50.258841 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 97/196] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:50 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:00:50.262507 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27630d10-ea46-4ea2-a29c-d5796e36a75e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:50.263057 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27630d10-ea46-4ea2-a29c-d5796e36a75e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:50.264006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27630d10-ea46-4ea2-a29c-d5796e36a75e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:50.264781 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27630d10-ea46-4ea2-a29c-d5796e36a75e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:50.381696 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-04402d51-f09b-481d-810d-c0101016fbcb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:50.383878 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-04402d51-f09b-481d-810d-c0101016fbcb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:50.390059 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04402d51-f09b-481d-810d-c0101016fbcb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:50.390687 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04402d51-f09b-481d-810d-c0101016fbcb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:50.391599 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04402d51-f09b-481d-810d-c0101016fbcb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:50.392166 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04402d51-f09b-481d-810d-c0101016fbcb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:50.409190 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-04402d51-f09b-481d-810d-c0101016fbcb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] HTTP exception thrown: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-04402d51-f09b-481d-810d-c0101016fbcb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Request method failure captured: Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de/os-volume_attachments HTTP/1.1 Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8zQ9G7AVbGuMJYPKDoOr0T33mKTIQonwfeDDR82nhCPPKOMSCJqT6sJKADjmW8dqWWPXA03HJpWk4zjlH7qr_ZNUKrMy3cPnWFVXbmBKpAlbkqFaRDf7ktszFhtUmBGr2WBPOpIKV9KTUGu9Tny1rmLSUTvrDvKGirH00VP-q5E5g Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 7ac9cd175c5b423389779d2f4f487287 Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-DeleteServersTestJSON-1078827501 Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:00:50.412513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:00:50.413952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ac9cd175c5b423389779d2f4f487287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ac9cd175c5b423389779d2f4f487287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ac9cd175c5b423389779d2f4f487287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ac9cd175c5b423389779d2f4f487287"}]}] Jul 31 20:00:50.413952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-DeleteServersTestJSON-1078827501 Jul 31 20:00:50.413952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7ac9cd175c5b423389779d2f4f487287 Jul 31 20:00:50.413952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1078827501 Jul 31 20:00:50.413952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-DeleteServersTestJSON-1078827501-project Jul 31 20:00:50.413952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:00:50.413952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:00:50.413952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 40ae686b7ff04508a6cfb6723f5d0f70 Jul 31 20:00:50.413952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-DeleteServersTestJSON-1078827501-project Jul 31 20:00:50.413952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:00:50.413952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:50.413952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'server_id': 'ef21f87f-e509-4c7d-883c-3e0f5d0672de'} Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:00:50.414732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:50.415970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:50.417839 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-04402d51-f09b-481d-810d-c0101016fbcb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Returning 404 to user: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:00:50.417839 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-04402d51-f09b-481d-810d-c0101016fbcb tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037421 Jul 31 20:00:50.417839 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 98/197] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:00:50 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:00:50.429624 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-27630d10-ea46-4ea2-a29c-d5796e36a75e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:50.438557 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-27630d10-ea46-4ea2-a29c-d5796e36a75e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.195079 Jul 31 20:00:50.439703 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 100/198] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:50 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:00:51.459987 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-32fba741-e812-447a-bb98-f2919a83d7f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:51.460571 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-32fba741-e812-447a-bb98-f2919a83d7f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:51.466784 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32fba741-e812-447a-bb98-f2919a83d7f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:51.467244 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32fba741-e812-447a-bb98-f2919a83d7f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:51.467998 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32fba741-e812-447a-bb98-f2919a83d7f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:51.468424 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32fba741-e812-447a-bb98-f2919a83d7f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:51.598890 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-32fba741-e812-447a-bb98-f2919a83d7f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:51.608842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-32fba741-e812-447a-bb98-f2919a83d7f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.152594 Jul 31 20:00:51.609630 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 99/199] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:51 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:51.624946 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-99fa53e3-e26f-4a40-b8ca-df9e911bcca7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:51.625595 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-99fa53e3-e26f-4a40-b8ca-df9e911bcca7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:51.628384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:51.634000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99fa53e3-e26f-4a40-b8ca-df9e911bcca7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:51.634441 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99fa53e3-e26f-4a40-b8ca-df9e911bcca7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:51.635183 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99fa53e3-e26f-4a40-b8ca-df9e911bcca7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:51.635608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99fa53e3-e26f-4a40-b8ca-df9e911bcca7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:51.650559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-99fa53e3-e26f-4a40-b8ca-df9e911bcca7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] HTTP exception thrown: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-99fa53e3-e26f-4a40-b8ca-df9e911bcca7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Request method failure captured: Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de HTTP/1.1 Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8zQ9G7AVbGuMJYPKDoOr0T33mKTIQonwfeDDR82nhCPPKOMSCJqT6sJKADjmW8dqWWPXA03HJpWk4zjlH7qr_ZNUKrMy3cPnWFVXbmBKpAlbkqFaRDf7ktszFhtUmBGr2WBPOpIKV9KTUGu9Tny1rmLSUTvrDvKGirH00VP-q5E5g Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 7ac9cd175c5b423389779d2f4f487287 Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-DeleteServersTestJSON-1078827501 Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:00:51.655529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:00:51.656707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ac9cd175c5b423389779d2f4f487287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ac9cd175c5b423389779d2f4f487287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ac9cd175c5b423389779d2f4f487287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ac9cd175c5b423389779d2f4f487287"}]}] Jul 31 20:00:51.656707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-DeleteServersTestJSON-1078827501 Jul 31 20:00:51.656707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 7ac9cd175c5b423389779d2f4f487287 Jul 31 20:00:51.656707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1078827501 Jul 31 20:00:51.656707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-DeleteServersTestJSON-1078827501-project Jul 31 20:00:51.656707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:00:51.656707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:00:51.656707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 40ae686b7ff04508a6cfb6723f5d0f70 Jul 31 20:00:51.656707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-DeleteServersTestJSON-1078827501-project Jul 31 20:00:51.656707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:00:51.656707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:51.656707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': 'ef21f87f-e509-4c7d-883c-3e0f5d0672de'} Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:00:51.657746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:51.659052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:51.660096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-99fa53e3-e26f-4a40-b8ca-df9e911bcca7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Returning 404 to user: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:00:51.660096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-99fa53e3-e26f-4a40-b8ca-df9e911bcca7 tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 404 len: 111 microversion: 2.1 time: 0.035932 Jul 31 20:00:51.660998 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 101/200] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:00:51 2022] DELETE /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:00:51.667047 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fd667646-ac1b-4ccd-9d84-504b71d17eea tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:51.667656 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fd667646-ac1b-4ccd-9d84-504b71d17eea tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] [instance: ef21f87f-e509-4c7d-883c-3e0f5d0672de] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:51.673830 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd667646-ac1b-4ccd-9d84-504b71d17eea tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:51.674300 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd667646-ac1b-4ccd-9d84-504b71d17eea tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:51.675056 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd667646-ac1b-4ccd-9d84-504b71d17eea tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:51.675437 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd667646-ac1b-4ccd-9d84-504b71d17eea tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:51.688552 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-fd667646-ac1b-4ccd-9d84-504b71d17eea tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] HTTP exception thrown: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fd667646-ac1b-4ccd-9d84-504b71d17eea tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Request method failure captured: Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de HTTP/1.1 Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8zQ9G7AVbGuMJYPKDoOr0T33mKTIQonwfeDDR82nhCPPKOMSCJqT6sJKADjmW8dqWWPXA03HJpWk4zjlH7qr_ZNUKrMy3cPnWFVXbmBKpAlbkqFaRDf7ktszFhtUmBGr2WBPOpIKV9KTUGu9Tny1rmLSUTvrDvKGirH00VP-q5E5g Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 7ac9cd175c5b423389779d2f4f487287 Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-DeleteServersTestJSON-1078827501 Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:00:51.690116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:00:51.691638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ac9cd175c5b423389779d2f4f487287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ac9cd175c5b423389779d2f4f487287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ac9cd175c5b423389779d2f4f487287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ac9cd175c5b423389779d2f4f487287"}]}] Jul 31 20:00:51.691638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-DeleteServersTestJSON-1078827501 Jul 31 20:00:51.691638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7ac9cd175c5b423389779d2f4f487287 Jul 31 20:00:51.691638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1078827501 Jul 31 20:00:51.691638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-DeleteServersTestJSON-1078827501-project Jul 31 20:00:51.691638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:00:51.691638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:00:51.691638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 40ae686b7ff04508a6cfb6723f5d0f70 Jul 31 20:00:51.691638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-DeleteServersTestJSON-1078827501-project Jul 31 20:00:51.691638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:00:51.691638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:51.691638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': 'ef21f87f-e509-4c7d-883c-3e0f5d0672de'} Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:00:51.692367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. Jul 31 20:00:51.693513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:51.694444 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fd667646-ac1b-4ccd-9d84-504b71d17eea tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] Returning 404 to user: Instance ef21f87f-e509-4c7d-883c-3e0f5d0672de could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:00:51.694444 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fd667646-ac1b-4ccd-9d84-504b71d17eea tempest-DeleteServersTestJSON-1078827501 tempest-DeleteServersTestJSON-1078827501-project] 10.222.0.48 "GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de" status: 404 len: 111 microversion: 2.1 time: 0.029276 Jul 31 20:00:51.694444 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 100/201] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:51 2022] GET /compute/v2.1/servers/ef21f87f-e509-4c7d-883c-3e0f5d0672de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:00:52.632937 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-02b97e88-f604-4d09-ab44-a69450706cb8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:52.633690 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-02b97e88-f604-4d09-ab44-a69450706cb8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:52.643955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02b97e88-f604-4d09-ab44-a69450706cb8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:52.644906 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02b97e88-f604-4d09-ab44-a69450706cb8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:52.645939 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02b97e88-f604-4d09-ab44-a69450706cb8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:52.646372 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02b97e88-f604-4d09-ab44-a69450706cb8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:52.852064 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-02b97e88-f604-4d09-ab44-a69450706cb8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:52.860950 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-02b97e88-f604-4d09-ab44-a69450706cb8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.234585 Jul 31 20:00:52.861577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 102/202] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:52 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:53.882268 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e04f0723-7552-4f15-9594-b69842f85c6b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:53.882912 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e04f0723-7552-4f15-9594-b69842f85c6b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:53.889013 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e04f0723-7552-4f15-9594-b69842f85c6b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:53.889858 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e04f0723-7552-4f15-9594-b69842f85c6b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:53.890903 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e04f0723-7552-4f15-9594-b69842f85c6b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:53.891605 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e04f0723-7552-4f15-9594-b69842f85c6b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:54.060686 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e04f0723-7552-4f15-9594-b69842f85c6b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:54.070460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e04f0723-7552-4f15-9594-b69842f85c6b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.191040 Jul 31 20:00:54.071136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 101/203] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:53 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:55.093936 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-63d80f12-cc26-44bb-9f91-07a4e58abbdd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:55.095766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-63d80f12-cc26-44bb-9f91-07a4e58abbdd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:55.103538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63d80f12-cc26-44bb-9f91-07a4e58abbdd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:55.103990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63d80f12-cc26-44bb-9f91-07a4e58abbdd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:55.104787 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63d80f12-cc26-44bb-9f91-07a4e58abbdd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:55.105416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63d80f12-cc26-44bb-9f91-07a4e58abbdd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:55.264836 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-63d80f12-cc26-44bb-9f91-07a4e58abbdd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:55.273682 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-63d80f12-cc26-44bb-9f91-07a4e58abbdd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.184734 Jul 31 20:00:55.287521 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 103/204] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:55 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:56.297225 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-36f8bcc4-97aa-4455-ab9b-c77704bd9f55 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:56.297736 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-36f8bcc4-97aa-4455-ab9b-c77704bd9f55 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:56.304543 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36f8bcc4-97aa-4455-ab9b-c77704bd9f55 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:56.304981 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36f8bcc4-97aa-4455-ab9b-c77704bd9f55 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:56.305771 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36f8bcc4-97aa-4455-ab9b-c77704bd9f55 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:56.306262 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36f8bcc4-97aa-4455-ab9b-c77704bd9f55 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:56.448878 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-36f8bcc4-97aa-4455-ab9b-c77704bd9f55 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:56.457238 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-36f8bcc4-97aa-4455-ab9b-c77704bd9f55 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.165879 Jul 31 20:00:56.457808 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 102/205] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:56 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:56.920226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-86749591-23a0-4fca-bf00-72c1b376885d tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Action: 'create', calling method: .version_select at 0x7ffa24c27280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-583441692", "metadata": {"Type": "work"}}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-86749591-23a0-4fca-bf00-72c1b376885d tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Request method failure captured: Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 121 Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t94zlW2O1EKBxOiYMbAcbdVFNlDQLsfM6PnVoi8wEA7IcUlxVp73EH9LLfnXtNoAdfxy8Ra5K3nqJhc9Nl2rMDiCmyn-Kk09AEg4lskBYjhMN-OZYINQKsU0SOE7uw1yZ2hdfQ6feIfUxcBAj7JEO-WjeJ96VrCv5KYxIG6NVbaUOM Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 21b055545f8e4efb80a29083f8aecea1 Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:00:56.927749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:00:56.929226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21b055545f8e4efb80a29083f8aecea1"}]}] Jul 31 20:00:56.929226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:56.929226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 21b055545f8e4efb80a29083f8aecea1 Jul 31 20:00:56.929226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:56.929226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesNegativeTest-1169736571-project Jul 31 20:00:56.929226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:00:56.929226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:00:56.929226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 8c7174182e274ce5af396483f3f6da30 Jul 31 20:00:56.929226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesNegativeTest-1169736571-project Jul 31 20:00:56.929226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Jul 31 20:00:56.929226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-583441692", "metadata": {"Type": "work"}}} Jul 31 20:00:56.929226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: Jul 31 20:00:56.929226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-583441692', 'metadata': {'Type': 'work'}}}} Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise error Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi '#$%' Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:00:56.930145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 20:00:56.931709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 20:00:56.932972 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 31 20:00:56.932972 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.932972 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-86749591-23a0-4fca-bf00-72c1b376885d tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:00:56.932972 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-86749591-23a0-4fca-bf00-72c1b376885d tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143087 Jul 31 20:00:56.932972 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 104/206] 10.222.0.48 () {60 vars in 1156 bytes} [Sun Jul 31 20:00:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 20:00:56.939434 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-afbb602d-6f98-4a8e-821c-f93e0cff2f18 tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Action: 'create', calling method: .version_select at 0x7ffa249c7b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-466882242", "metadata": {"Type": "work"}}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-afbb602d-6f98-4a8e-821c-f93e0cff2f18 tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Request method failure captured: Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 119 Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t94zlW2O1EKBxOiYMbAcbdVFNlDQLsfM6PnVoi8wEA7IcUlxVp73EH9LLfnXtNoAdfxy8Ra5K3nqJhc9Nl2rMDiCmyn-Kk09AEg4lskBYjhMN-OZYINQKsU0SOE7uw1yZ2hdfQ6feIfUxcBAj7JEO-WjeJ96VrCv5KYxIG6NVbaUOM Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 21b055545f8e4efb80a29083f8aecea1 Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:00:56.944274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:00:56.945518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21b055545f8e4efb80a29083f8aecea1"}]}] Jul 31 20:00:56.945518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:56.945518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 21b055545f8e4efb80a29083f8aecea1 Jul 31 20:00:56.945518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:56.945518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1169736571-project Jul 31 20:00:56.945518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:00:56.945518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:00:56.945518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 8c7174182e274ce5af396483f3f6da30 Jul 31 20:00:56.945518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1169736571-project Jul 31 20:00:56.945518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Jul 31 20:00:56.945518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-466882242", "metadata": {"Type": "work"}}} Jul 31 20:00:56.945518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: Jul 31 20:00:56.945518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-466882242', 'metadata': {'Type': 'work'}}}} Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise error Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi '0' Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:00:56.950923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 20:00:56.952416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 20:00:56.953929 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 31 20:00:56.953929 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.953929 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-afbb602d-6f98-4a8e-821c-f93e0cff2f18 tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:00:56.953929 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-afbb602d-6f98-4a8e-821c-f93e0cff2f18 tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010265 Jul 31 20:00:56.953929 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 103/207] 10.222.0.48 () {60 vars in 1156 bytes} [Sun Jul 31 20:00:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 20:00:56.958409 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e8bc1a8b-3c25-48c0-81fa-d7f4333e769d tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Action: 'create', calling method: .version_select at 0x7ffa24950310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1391850579", "metadata": {"Type": "work"}}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e8bc1a8b-3c25-48c0-81fa-d7f4333e769d tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Request method failure captured: Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 119 Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t94zlW2O1EKBxOiYMbAcbdVFNlDQLsfM6PnVoi8wEA7IcUlxVp73EH9LLfnXtNoAdfxy8Ra5K3nqJhc9Nl2rMDiCmyn-Kk09AEg4lskBYjhMN-OZYINQKsU0SOE7uw1yZ2hdfQ6feIfUxcBAj7JEO-WjeJ96VrCv5KYxIG6NVbaUOM Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 21b055545f8e4efb80a29083f8aecea1 Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:00:56.962086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:00:56.963540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21b055545f8e4efb80a29083f8aecea1"}]}] Jul 31 20:00:56.963540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:56.963540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 21b055545f8e4efb80a29083f8aecea1 Jul 31 20:00:56.963540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:56.963540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesNegativeTest-1169736571-project Jul 31 20:00:56.963540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:00:56.963540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:00:56.963540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 8c7174182e274ce5af396483f3f6da30 Jul 31 20:00:56.963540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesNegativeTest-1169736571-project Jul 31 20:00:56.963540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Jul 31 20:00:56.963540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1391850579", "metadata": {"Type": "work"}}} Jul 31 20:00:56.963540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: Jul 31 20:00:56.963540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1391850579', 'metadata': {'Type': 'work'}}}} Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise error Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi '' Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:00:56.964314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 20:00:56.965774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 20:00:56.968464 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 31 20:00:56.968464 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:56.968464 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e8bc1a8b-3c25-48c0-81fa-d7f4333e769d tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:00:56.968464 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e8bc1a8b-3c25-48c0-81fa-d7f4333e769d tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008924 Jul 31 20:00:56.968464 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 105/208] 10.222.0.48 () {60 vars in 1156 bytes} [Sun Jul 31 20:00:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 20:00:56.972959 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5ea7ab09-f5ef-4563-ada4-55e05c7b5336 tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Calling method '.version_select at 0x7ffa249c39d0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:57.002759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-5ea7ab09-f5ef-4563-ada4-55e05c7b5336 tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] HTTP exception thrown: Volume tempest-invalid-491126360 could not be found. Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5ea7ab09-f5ef-4563-ada4-55e05c7b5336 tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Request method failure captured: Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-491126360 HTTP/1.1 Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t94zlW2O1EKBxOiYMbAcbdVFNlDQLsfM6PnVoi8wEA7IcUlxVp73EH9LLfnXtNoAdfxy8Ra5K3nqJhc9Nl2rMDiCmyn-Kk09AEg4lskBYjhMN-OZYINQKsU0SOE7uw1yZ2hdfQ6feIfUxcBAj7JEO-WjeJ96VrCv5KYxIG6NVbaUOM Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 21b055545f8e4efb80a29083f8aecea1 Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:00:57.005954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:00:57.007193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21b055545f8e4efb80a29083f8aecea1"}]}] Jul 31 20:00:57.007193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:57.007193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 21b055545f8e4efb80a29083f8aecea1 Jul 31 20:00:57.007193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:57.007193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1169736571-project Jul 31 20:00:57.007193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:00:57.007193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:00:57.007193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 8c7174182e274ce5af396483f3f6da30 Jul 31 20:00:57.007193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1169736571-project Jul 31 20:00:57.007193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: Jul 31 20:00:57.007193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Volume tempest-invalid-491126360 could not be found. Jul 31 20:00:57.007193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': 'tempest-invalid-491126360'} Jul 31 20:00:57.007193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-491126360 could not be found. (HTTP 404) (Request-ID: req-05363857-aaf3-4a09-a3d9-9cd27b0f75c5) Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:57.013111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 20:00:57.014176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-491126360 could not be found. Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:00:57.016037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-491126360 could not be found. Jul 31 20:00:57.018325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.018325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:57.018325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.018325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:57.018325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:57.018325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:57.018325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:00:57.018325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:00:57.018325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-491126360 could not be found. Jul 31 20:00:57.018325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.018325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5ea7ab09-f5ef-4563-ada4-55e05c7b5336 tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Returning 404 to user: Volume tempest-invalid-491126360 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:00:57.018325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5ea7ab09-f5ef-4563-ada4-55e05c7b5336 tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-491126360" status: 404 len: 98 microversion: 2.1 time: 0.038230 Jul 31 20:00:57.018325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 104/209] 10.222.0.48 () {58 vars in 1215 bytes} [Sun Jul 31 20:00:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-491126360 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 20:00:57.020517 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-90161e8f-f902-4f59-a817-921a606c004c tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003746 Jul 31 20:00:57.020517 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 106/210] 10.222.0.48 () {58 vars in 1140 bytes} [Sun Jul 31 20:00:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 31 20:00:57.030193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a7a754d6-82d8-41de-9f17-b62a8a94fd1b tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006006 Jul 31 20:00:57.031063 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 105/211] 10.222.0.48 () {58 vars in 1137 bytes} [Sun Jul 31 20:00:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 31 20:00:57.040335 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c6ba128a-d993-4431-a22f-56451d03bbfa tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Calling method '.version_select at 0x7ffa2495d5e0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:57.072244 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-c6ba128a-d993-4431-a22f-56451d03bbfa tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] HTTP exception thrown: Volume 8c0485ca-12e0-4509-bc17-1fe0778dcd4f could not be found. Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c6ba128a-d993-4431-a22f-56451d03bbfa tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Request method failure captured: Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/os-volumes/8c0485ca-12e0-4509-bc17-1fe0778dcd4f HTTP/1.1 Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t94zlW2O1EKBxOiYMbAcbdVFNlDQLsfM6PnVoi8wEA7IcUlxVp73EH9LLfnXtNoAdfxy8Ra5K3nqJhc9Nl2rMDiCmyn-Kk09AEg4lskBYjhMN-OZYINQKsU0SOE7uw1yZ2hdfQ6feIfUxcBAj7JEO-WjeJ96VrCv5KYxIG6NVbaUOM Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 21b055545f8e4efb80a29083f8aecea1 Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:00:57.076179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:00:57.077527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21b055545f8e4efb80a29083f8aecea1"}]}] Jul 31 20:00:57.077527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:57.077527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 21b055545f8e4efb80a29083f8aecea1 Jul 31 20:00:57.077527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:57.077527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesNegativeTest-1169736571-project Jul 31 20:00:57.077527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:00:57.077527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:00:57.077527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 8c7174182e274ce5af396483f3f6da30 Jul 31 20:00:57.077527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesNegativeTest-1169736571-project Jul 31 20:00:57.077527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: Jul 31 20:00:57.077527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Volume 8c0485ca-12e0-4509-bc17-1fe0778dcd4f could not be found. Jul 31 20:00:57.077527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '8c0485ca-12e0-4509-bc17-1fe0778dcd4f'} Jul 31 20:00:57.077527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c0485ca-12e0-4509-bc17-1fe0778dcd4f could not be found. (HTTP 404) (Request-ID: req-b2d336bf-6de8-48cc-a750-50503c26de41) Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:57.078499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 20:00:57.079724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c0485ca-12e0-4509-bc17-1fe0778dcd4f could not be found. Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 31 20:00:57.080778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c0485ca-12e0-4509-bc17-1fe0778dcd4f could not be found. Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c0485ca-12e0-4509-bc17-1fe0778dcd4f could not be found. Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c6ba128a-d993-4431-a22f-56451d03bbfa tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Returning 404 to user: Volume 8c0485ca-12e0-4509-bc17-1fe0778dcd4f could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c6ba128a-d993-4431-a22f-56451d03bbfa tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/8c0485ca-12e0-4509-bc17-1fe0778dcd4f" status: 404 len: 109 microversion: 2.1 time: 0.041764 Jul 31 20:00:57.081825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 107/212] 10.222.0.48 () {58 vars in 1248 bytes} [Sun Jul 31 20:00:57 2022] DELETE /compute/v2.1/os-volumes/8c0485ca-12e0-4509-bc17-1fe0778dcd4f => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 20:00:57.087780 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-83468191-e720-494c-81fc-26917b231c8f tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Calling method '.version_select at 0x7ffa2662be50>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:57.114869 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-83468191-e720-494c-81fc-26917b231c8f tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] HTTP exception thrown: Volume 79df7448-785f-4937-b754-ceb1094f1b36 could not be found. Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-83468191-e720-494c-81fc-26917b231c8f tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Request method failure captured: Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/os-volumes/79df7448-785f-4937-b754-ceb1094f1b36 HTTP/1.1 Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t94zlW2O1EKBxOiYMbAcbdVFNlDQLsfM6PnVoi8wEA7IcUlxVp73EH9LLfnXtNoAdfxy8Ra5K3nqJhc9Nl2rMDiCmyn-Kk09AEg4lskBYjhMN-OZYINQKsU0SOE7uw1yZ2hdfQ6feIfUxcBAj7JEO-WjeJ96VrCv5KYxIG6NVbaUOM Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 21b055545f8e4efb80a29083f8aecea1 Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:00:57.116851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:00:57.118346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21b055545f8e4efb80a29083f8aecea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21b055545f8e4efb80a29083f8aecea1"}]}] Jul 31 20:00:57.118346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:57.118346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 21b055545f8e4efb80a29083f8aecea1 Jul 31 20:00:57.118346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1169736571 Jul 31 20:00:57.118346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1169736571-project Jul 31 20:00:57.118346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:00:57.118346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:00:57.118346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 8c7174182e274ce5af396483f3f6da30 Jul 31 20:00:57.118346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1169736571-project Jul 31 20:00:57.118346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: Jul 31 20:00:57.118346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Volume 79df7448-785f-4937-b754-ceb1094f1b36 could not be found. Jul 31 20:00:57.118346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': '79df7448-785f-4937-b754-ceb1094f1b36'} Jul 31 20:00:57.118346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79df7448-785f-4937-b754-ceb1094f1b36 could not be found. (HTTP 404) (Request-ID: req-b1b0add9-9bf9-4f92-8416-37d816170ce9) Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:57.119608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 20:00:57.120797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79df7448-785f-4937-b754-ceb1094f1b36 could not be found. Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 20:00:57.122083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79df7448-785f-4937-b754-ceb1094f1b36 could not be found. Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79df7448-785f-4937-b754-ceb1094f1b36 could not be found. Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-83468191-e720-494c-81fc-26917b231c8f tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] Returning 404 to user: Volume 79df7448-785f-4937-b754-ceb1094f1b36 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-83468191-e720-494c-81fc-26917b231c8f tempest-VolumesNegativeTest-1169736571 tempest-VolumesNegativeTest-1169736571-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/79df7448-785f-4937-b754-ceb1094f1b36" status: 404 len: 109 microversion: 2.1 time: 0.034441 Jul 31 20:00:57.123287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 106/213] 10.222.0.48 () {58 vars in 1245 bytes} [Sun Jul 31 20:00:57 2022] GET /compute/v2.1/os-volumes/79df7448-785f-4937-b754-ceb1094f1b36 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:00:57.480699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-90e941ba-e63a-47cf-928e-521bf4bb0bb2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:57.480699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-90e941ba-e63a-47cf-928e-521bf4bb0bb2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:57.486272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90e941ba-e63a-47cf-928e-521bf4bb0bb2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:57.486792 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90e941ba-e63a-47cf-928e-521bf4bb0bb2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:57.487658 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90e941ba-e63a-47cf-928e-521bf4bb0bb2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:57.488196 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90e941ba-e63a-47cf-928e-521bf4bb0bb2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:57.684218 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-90e941ba-e63a-47cf-928e-521bf4bb0bb2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:57.692145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-90e941ba-e63a-47cf-928e-521bf4bb0bb2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.217396 Jul 31 20:00:57.692699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 108/214] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:57 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:58.714137 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-db76b5ca-2a87-4987-af31-2ea239c7a182 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:58.715486 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-db76b5ca-2a87-4987-af31-2ea239c7a182 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:58.717794 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=61 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:00:58.723090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db76b5ca-2a87-4987-af31-2ea239c7a182 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:58.723735 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db76b5ca-2a87-4987-af31-2ea239c7a182 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:58.724674 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db76b5ca-2a87-4987-af31-2ea239c7a182 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:58.725905 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db76b5ca-2a87-4987-af31-2ea239c7a182 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:58.889599 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-db76b5ca-2a87-4987-af31-2ea239c7a182 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:00:58.898446 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-db76b5ca-2a87-4987-af31-2ea239c7a182 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.188072 Jul 31 20:00:58.899223 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 107/215] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:58 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:00:59.919370 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-775237b1-4531-430f-85af-57e54adfaaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:00:59.920031 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-775237b1-4531-430f-85af-57e54adfaaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:00:59.926360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-775237b1-4531-430f-85af-57e54adfaaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:59.935744 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-775237b1-4531-430f-85af-57e54adfaaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:00:59.936700 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-775237b1-4531-430f-85af-57e54adfaaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:00:59.937357 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-775237b1-4531-430f-85af-57e54adfaaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:00.121656 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-775237b1-4531-430f-85af-57e54adfaaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:00.129782 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-775237b1-4531-430f-85af-57e54adfaaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.214179 Jul 31 20:01:00.130345 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 109/216] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:00:59 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:01.151714 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c224d216-1cd5-4205-8224-9a32bc337aea tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:01.152950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c224d216-1cd5-4205-8224-9a32bc337aea tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:01.159710 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c224d216-1cd5-4205-8224-9a32bc337aea tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:01.160465 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c224d216-1cd5-4205-8224-9a32bc337aea tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:01.161430 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c224d216-1cd5-4205-8224-9a32bc337aea tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:01.161867 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c224d216-1cd5-4205-8224-9a32bc337aea tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:01.398683 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c224d216-1cd5-4205-8224-9a32bc337aea tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:01.408498 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c224d216-1cd5-4205-8224-9a32bc337aea tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.261188 Jul 31 20:01:01.409911 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 108/217] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:01 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:02.430962 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7a8abe5c-0d3f-447e-b782-c397b62bf1df tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:02.432263 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7a8abe5c-0d3f-447e-b782-c397b62bf1df tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:02.439768 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a8abe5c-0d3f-447e-b782-c397b62bf1df tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:02.440862 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a8abe5c-0d3f-447e-b782-c397b62bf1df tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:02.442431 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a8abe5c-0d3f-447e-b782-c397b62bf1df tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:02.442926 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a8abe5c-0d3f-447e-b782-c397b62bf1df tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:02.715754 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7a8abe5c-0d3f-447e-b782-c397b62bf1df tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:02.725763 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7a8abe5c-0d3f-447e-b782-c397b62bf1df tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.298083 Jul 31 20:01:02.727035 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 110/218] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:02 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:03.747515 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-722d83f0-7eac-4297-95cd-ecac1eeb9c6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:03.749069 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-722d83f0-7eac-4297-95cd-ecac1eeb9c6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:03.756299 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-722d83f0-7eac-4297-95cd-ecac1eeb9c6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:03.756836 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-722d83f0-7eac-4297-95cd-ecac1eeb9c6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:03.757690 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-722d83f0-7eac-4297-95cd-ecac1eeb9c6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:03.758190 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-722d83f0-7eac-4297-95cd-ecac1eeb9c6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:04.001289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-722d83f0-7eac-4297-95cd-ecac1eeb9c6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:04.010365 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-722d83f0-7eac-4297-95cd-ecac1eeb9c6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.267033 Jul 31 20:01:04.010938 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 109/219] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:03 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:05.031214 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9558230e-73a8-4b0d-9b6e-8cb8acde7bf2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:05.031944 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9558230e-73a8-4b0d-9b6e-8cb8acde7bf2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:05.039578 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9558230e-73a8-4b0d-9b6e-8cb8acde7bf2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:05.040360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9558230e-73a8-4b0d-9b6e-8cb8acde7bf2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:05.041400 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9558230e-73a8-4b0d-9b6e-8cb8acde7bf2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:05.042040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9558230e-73a8-4b0d-9b6e-8cb8acde7bf2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:05.228253 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9558230e-73a8-4b0d-9b6e-8cb8acde7bf2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:05.236522 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9558230e-73a8-4b0d-9b6e-8cb8acde7bf2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.209224 Jul 31 20:01:05.237093 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 111/220] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:05 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:06.256954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1d2455a4-e234-458c-9f4a-0ba69a9cc84a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:06.257675 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1d2455a4-e234-458c-9f4a-0ba69a9cc84a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:06.269808 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d2455a4-e234-458c-9f4a-0ba69a9cc84a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:06.270347 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d2455a4-e234-458c-9f4a-0ba69a9cc84a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:06.271198 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d2455a4-e234-458c-9f4a-0ba69a9cc84a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:06.271690 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d2455a4-e234-458c-9f4a-0ba69a9cc84a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:06.416355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1d2455a4-e234-458c-9f4a-0ba69a9cc84a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:06.424243 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1d2455a4-e234-458c-9f4a-0ba69a9cc84a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.171253 Jul 31 20:01:06.425735 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 110/221] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:06 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:07.450317 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ce57112b-3ecd-44c6-9c99-4e7128de8e81 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:07.452534 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ce57112b-3ecd-44c6-9c99-4e7128de8e81 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:07.465019 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce57112b-3ecd-44c6-9c99-4e7128de8e81 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:07.466938 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce57112b-3ecd-44c6-9c99-4e7128de8e81 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:07.468833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce57112b-3ecd-44c6-9c99-4e7128de8e81 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:07.469956 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce57112b-3ecd-44c6-9c99-4e7128de8e81 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:07.783228 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ce57112b-3ecd-44c6-9c99-4e7128de8e81 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:07.787035 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:07.792351 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ce57112b-3ecd-44c6-9c99-4e7128de8e81 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.349725 Jul 31 20:01:07.803732 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 112/222] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:07 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:08.815848 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4da42d15-2e8c-41b5-8bb1-dc7690de8f53 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:08.816475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4da42d15-2e8c-41b5-8bb1-dc7690de8f53 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:08.828427 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4da42d15-2e8c-41b5-8bb1-dc7690de8f53 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:08.828885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4da42d15-2e8c-41b5-8bb1-dc7690de8f53 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:08.830189 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4da42d15-2e8c-41b5-8bb1-dc7690de8f53 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:08.830189 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4da42d15-2e8c-41b5-8bb1-dc7690de8f53 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:09.017085 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4da42d15-2e8c-41b5-8bb1-dc7690de8f53 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:09.028374 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4da42d15-2e8c-41b5-8bb1-dc7690de8f53 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.218685 Jul 31 20:01:09.029312 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 111/223] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:08 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:10.055542 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-176eaa7a-a472-44cd-9984-96abdd7ea50d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:10.056946 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-176eaa7a-a472-44cd-9984-96abdd7ea50d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:10.066301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-176eaa7a-a472-44cd-9984-96abdd7ea50d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:10.067210 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-176eaa7a-a472-44cd-9984-96abdd7ea50d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:10.068263 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-176eaa7a-a472-44cd-9984-96abdd7ea50d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:10.068899 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-176eaa7a-a472-44cd-9984-96abdd7ea50d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:10.238685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-176eaa7a-a472-44cd-9984-96abdd7ea50d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:10.247635 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-176eaa7a-a472-44cd-9984-96abdd7ea50d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.199503 Jul 31 20:01:10.261677 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 113/224] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:10 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:11.270647 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4dc6d85b-0b2f-4748-ac7d-a36838c875c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:11.271983 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4dc6d85b-0b2f-4748-ac7d-a36838c875c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:11.279338 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4dc6d85b-0b2f-4748-ac7d-a36838c875c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:11.279787 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4dc6d85b-0b2f-4748-ac7d-a36838c875c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:11.280505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4aded3b-7356-48ec-ab3e-d418b1e16ab6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Action: 'create', calling method: .version_select at 0x7ffa249a6ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1052386514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN0Nql/JiKSjJaYkTz/DMCFdeyjZ4s6IkLG53zgrZSbA3yco0m9T1TPD4DEmId5EoWEyQV6Yo3NUp82PQY60GCI4zXQEScB++1SGrK5HGIG5Es0pjqSNhrEUYTNb1Pswg=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:01:11.280960 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4dc6d85b-0b2f-4748-ac7d-a36838c875c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:11.280960 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4dc6d85b-0b2f-4748-ac7d-a36838c875c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:11.298551 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d4aded3b-7356-48ec-ab3e-d418b1e16ab6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Getting quotas for project 15e426e0b2bd4bc29e7a8e222fcc8f7e. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:01:11.304103 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d4aded3b-7356-48ec-ab3e-d418b1e16ab6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Getting quotas for user c6d7c6c7a3b5413c9c8d5c1e69d9db4c and project 15e426e0b2bd4bc29e7a8e222fcc8f7e. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:01:11.335403 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d4aded3b-7356-48ec-ab3e-d418b1e16ab6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.316334 Jul 31 20:01:11.335917 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 112/225] 10.222.0.48 () {60 vars in 1159 bytes} [Sun Jul 31 20:01:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:01:11.426121 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4dc6d85b-0b2f-4748-ac7d-a36838c875c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:11.434646 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4dc6d85b-0b2f-4748-ac7d-a36838c875c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.167864 Jul 31 20:01:11.436670 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 114/226] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:11 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:12.459384 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4c198d4f-cc9b-42e5-b27e-85daf872914d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:12.462263 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4c198d4f-cc9b-42e5-b27e-85daf872914d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:12.471490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c198d4f-cc9b-42e5-b27e-85daf872914d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:12.472867 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c198d4f-cc9b-42e5-b27e-85daf872914d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:12.475133 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c198d4f-cc9b-42e5-b27e-85daf872914d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:12.475801 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c198d4f-cc9b-42e5-b27e-85daf872914d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:12.896760 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4c198d4f-cc9b-42e5-b27e-85daf872914d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:12.904590 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4c198d4f-cc9b-42e5-b27e-85daf872914d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.451379 Jul 31 20:01:12.905504 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 113/227] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:12 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:13.926986 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b0f349d0-390c-42b6-8da7-4e093ba29a7a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:13.927530 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b0f349d0-390c-42b6-8da7-4e093ba29a7a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:13.934619 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0f349d0-390c-42b6-8da7-4e093ba29a7a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:13.935828 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0f349d0-390c-42b6-8da7-4e093ba29a7a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:13.936669 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0f349d0-390c-42b6-8da7-4e093ba29a7a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:13.937193 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0f349d0-390c-42b6-8da7-4e093ba29a7a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:14.107155 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b0f349d0-390c-42b6-8da7-4e093ba29a7a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:14.114994 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b0f349d0-390c-42b6-8da7-4e093ba29a7a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.193276 Jul 31 20:01:14.115564 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 115/228] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:13 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:15.136235 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-54283499-c277-490a-8387-1ba07a2b4602 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:15.136828 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-54283499-c277-490a-8387-1ba07a2b4602 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:15.143571 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54283499-c277-490a-8387-1ba07a2b4602 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:15.144020 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54283499-c277-490a-8387-1ba07a2b4602 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:15.144800 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54283499-c277-490a-8387-1ba07a2b4602 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:15.145263 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54283499-c277-490a-8387-1ba07a2b4602 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:15.284524 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-54283499-c277-490a-8387-1ba07a2b4602 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:15.292284 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-54283499-c277-490a-8387-1ba07a2b4602 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.160035 Jul 31 20:01:15.292859 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 114/229] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:15 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:16.316425 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ed7d9fa6-719e-4624-b3d7-8d8ba876af42 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:16.317468 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ed7d9fa6-719e-4624-b3d7-8d8ba876af42 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:16.328907 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed7d9fa6-719e-4624-b3d7-8d8ba876af42 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:16.329673 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed7d9fa6-719e-4624-b3d7-8d8ba876af42 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:16.331103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed7d9fa6-719e-4624-b3d7-8d8ba876af42 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:16.331536 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed7d9fa6-719e-4624-b3d7-8d8ba876af42 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:16.478639 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ed7d9fa6-719e-4624-b3d7-8d8ba876af42 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:16.486824 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ed7d9fa6-719e-4624-b3d7-8d8ba876af42 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.176857 Jul 31 20:01:16.487495 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 116/230] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:16 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:17.523937 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8cc70dc7-9962-4cdf-9ee3-04e7e58ad052 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:17.524621 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8cc70dc7-9962-4cdf-9ee3-04e7e58ad052 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:17.530934 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cc70dc7-9962-4cdf-9ee3-04e7e58ad052 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:17.531416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cc70dc7-9962-4cdf-9ee3-04e7e58ad052 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:17.532238 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cc70dc7-9962-4cdf-9ee3-04e7e58ad052 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:17.532712 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cc70dc7-9962-4cdf-9ee3-04e7e58ad052 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:17.667185 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8cc70dc7-9962-4cdf-9ee3-04e7e58ad052 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:17.675312 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8cc70dc7-9962-4cdf-9ee3-04e7e58ad052 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.168859 Jul 31 20:01:17.676525 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 115/231] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:17 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:18.696898 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f77c6669-da21-4514-bc1d-55acc0ebf3e8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:18.697509 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f77c6669-da21-4514-bc1d-55acc0ebf3e8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:18.715682 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f77c6669-da21-4514-bc1d-55acc0ebf3e8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:18.718246 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f77c6669-da21-4514-bc1d-55acc0ebf3e8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:18.721260 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f77c6669-da21-4514-bc1d-55acc0ebf3e8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:18.721768 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f77c6669-da21-4514-bc1d-55acc0ebf3e8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:19.050550 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f77c6669-da21-4514-bc1d-55acc0ebf3e8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:19.058552 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f77c6669-da21-4514-bc1d-55acc0ebf3e8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.366079 Jul 31 20:01:19.059233 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 117/232] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:18 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:20.079015 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-09ed1100-36cb-4f30-8b5a-2315c41f0233 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:20.079559 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-09ed1100-36cb-4f30-8b5a-2315c41f0233 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:20.086488 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09ed1100-36cb-4f30-8b5a-2315c41f0233 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:20.087200 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09ed1100-36cb-4f30-8b5a-2315c41f0233 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:20.088010 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09ed1100-36cb-4f30-8b5a-2315c41f0233 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:20.088439 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09ed1100-36cb-4f30-8b5a-2315c41f0233 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:20.239893 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-09ed1100-36cb-4f30-8b5a-2315c41f0233 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:20.251169 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-09ed1100-36cb-4f30-8b5a-2315c41f0233 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1521 microversion: 2.1 time: 0.175990 Jul 31 20:01:20.251746 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 116/233] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:20 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:21.271966 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b5646cdc-89ff-4745-9b67-4f506f43e8ff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:21.272580 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b5646cdc-89ff-4745-9b67-4f506f43e8ff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:21.279786 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5646cdc-89ff-4745-9b67-4f506f43e8ff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:21.280033 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5646cdc-89ff-4745-9b67-4f506f43e8ff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:21.280759 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5646cdc-89ff-4745-9b67-4f506f43e8ff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:21.281184 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5646cdc-89ff-4745-9b67-4f506f43e8ff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:21.437333 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b5646cdc-89ff-4745-9b67-4f506f43e8ff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:21.448597 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b5646cdc-89ff-4745-9b67-4f506f43e8ff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1501 microversion: 2.1 time: 0.180441 Jul 31 20:01:21.453284 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 118/234] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:21 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:21.469028 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4cd50970-33fd-489a-8e0b-baafe2c9c209 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:21.469713 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4cd50970-33fd-489a-8e0b-baafe2c9c209 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:21.471581 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:21.477777 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4cd50970-33fd-489a-8e0b-baafe2c9c209 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:21.478248 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4cd50970-33fd-489a-8e0b-baafe2c9c209 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:21.478977 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4cd50970-33fd-489a-8e0b-baafe2c9c209 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:21.479400 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4cd50970-33fd-489a-8e0b-baafe2c9c209 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:21.482326 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=77 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:21.614335 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4cd50970-33fd-489a-8e0b-baafe2c9c209 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:21.622394 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4cd50970-33fd-489a-8e0b-baafe2c9c209 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1515 microversion: 2.1 time: 0.157596 Jul 31 20:01:21.623059 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 117/235] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:21 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:23.059926 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-034dfd90-cb19-4a68-b8c9-096281f1eabc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:01:23.062714 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-034dfd90-cb19-4a68-b8c9-096281f1eabc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:23.065584 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=28 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:23.070837 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-034dfd90-cb19-4a68-b8c9-096281f1eabc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:23.071361 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-034dfd90-cb19-4a68-b8c9-096281f1eabc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:23.072033 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-034dfd90-cb19-4a68-b8c9-096281f1eabc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:23.072456 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-034dfd90-cb19-4a68-b8c9-096281f1eabc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:23.096671 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-034dfd90-cb19-4a68-b8c9-096281f1eabc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lazy-loading 'flavor' on Instance uuid a098dc51-df70-4d1b-ae0b-264fdb83e932 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:01:23.171919 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-034dfd90-cb19-4a68-b8c9-096281f1eabc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "POST /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932/action" status: 200 len: 32 microversion: 2.1 time: 0.116155 Jul 31 20:01:23.172558 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 119/236] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:01:23 2022] POST /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932/action => generated 32 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 20:01:23.182359 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e7f3cdea-8dab-4325-a445-e767e52db802 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:23.182968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e7f3cdea-8dab-4325-a445-e767e52db802 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:23.190916 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7f3cdea-8dab-4325-a445-e767e52db802 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:23.191092 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7f3cdea-8dab-4325-a445-e767e52db802 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:23.192215 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7f3cdea-8dab-4325-a445-e767e52db802 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:23.192645 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7f3cdea-8dab-4325-a445-e767e52db802 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:23.440571 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e7f3cdea-8dab-4325-a445-e767e52db802 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:23.448889 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e7f3cdea-8dab-4325-a445-e767e52db802 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.270495 Jul 31 20:01:23.449741 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 118/237] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:23 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:24.475714 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-acfac5b9-c065-4efc-9009-d2a8ea4df9cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:24.476700 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-acfac5b9-c065-4efc-9009-d2a8ea4df9cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:24.487715 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-acfac5b9-c065-4efc-9009-d2a8ea4df9cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:24.488164 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-acfac5b9-c065-4efc-9009-d2a8ea4df9cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:24.489327 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-acfac5b9-c065-4efc-9009-d2a8ea4df9cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:24.489848 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-acfac5b9-c065-4efc-9009-d2a8ea4df9cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:24.630738 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-acfac5b9-c065-4efc-9009-d2a8ea4df9cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:24.638922 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-acfac5b9-c065-4efc-9009-d2a8ea4df9cd tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.171360 Jul 31 20:01:24.639494 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 120/238] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:24 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:25.660770 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3da0961a-96b8-4654-8e13-03729e84eda8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:25.661509 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3da0961a-96b8-4654-8e13-03729e84eda8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:25.668013 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3da0961a-96b8-4654-8e13-03729e84eda8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:25.668468 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3da0961a-96b8-4654-8e13-03729e84eda8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:25.669262 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3da0961a-96b8-4654-8e13-03729e84eda8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:25.669689 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3da0961a-96b8-4654-8e13-03729e84eda8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:25.809456 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3da0961a-96b8-4654-8e13-03729e84eda8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:25.816894 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3da0961a-96b8-4654-8e13-03729e84eda8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.160482 Jul 31 20:01:25.817599 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 119/239] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:25 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:26.838821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d906f7b0-2458-47ec-89ae-f14155fc6bf3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:26.839599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d906f7b0-2458-47ec-89ae-f14155fc6bf3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:26.846046 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d906f7b0-2458-47ec-89ae-f14155fc6bf3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:26.846490 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d906f7b0-2458-47ec-89ae-f14155fc6bf3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:26.847243 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d906f7b0-2458-47ec-89ae-f14155fc6bf3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:26.847668 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d906f7b0-2458-47ec-89ae-f14155fc6bf3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:26.983394 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d906f7b0-2458-47ec-89ae-f14155fc6bf3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:26.991473 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d906f7b0-2458-47ec-89ae-f14155fc6bf3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.156649 Jul 31 20:01:26.992073 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 121/240] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:26 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:28.018247 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-54aaea35-c68d-4b59-a4bc-3bd13fd555ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:28.019780 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-54aaea35-c68d-4b59-a4bc-3bd13fd555ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:28.030315 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54aaea35-c68d-4b59-a4bc-3bd13fd555ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:28.031052 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54aaea35-c68d-4b59-a4bc-3bd13fd555ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:28.032308 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54aaea35-c68d-4b59-a4bc-3bd13fd555ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:28.033021 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54aaea35-c68d-4b59-a4bc-3bd13fd555ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:28.168280 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-54aaea35-c68d-4b59-a4bc-3bd13fd555ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:28.176905 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-54aaea35-c68d-4b59-a4bc-3bd13fd555ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.165294 Jul 31 20:01:28.177624 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 120/241] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:28 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:29.202864 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f7e704b0-0cd8-4167-bdc3-f4909f2bc383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:29.203795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f7e704b0-0cd8-4167-bdc3-f4909f2bc383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:29.216029 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7e704b0-0cd8-4167-bdc3-f4909f2bc383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:29.216957 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7e704b0-0cd8-4167-bdc3-f4909f2bc383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:29.218402 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7e704b0-0cd8-4167-bdc3-f4909f2bc383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:29.219175 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7e704b0-0cd8-4167-bdc3-f4909f2bc383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:29.322479 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3e5c06cd-4143-400f-9154-138915df0626 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:29.323803 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3e5c06cd-4143-400f-9154-138915df0626 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:29.330441 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:29.332870 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e5c06cd-4143-400f-9154-138915df0626 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:29.333776 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e5c06cd-4143-400f-9154-138915df0626 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:29.334774 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e5c06cd-4143-400f-9154-138915df0626 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:29.335400 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e5c06cd-4143-400f-9154-138915df0626 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:29.369749 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3e5c06cd-4143-400f-9154-138915df0626 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/ips" status: 200 len: 150 microversion: 2.1 time: 0.050993 Jul 31 20:01:29.370549 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 121/242] 10.222.0.48 () {58 vars in 1248 bytes} [Sun Jul 31 20:01:29 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:01:29.390651 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f7e704b0-0cd8-4167-bdc3-f4909f2bc383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:29.398920 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f7e704b0-0cd8-4167-bdc3-f4909f2bc383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.202408 Jul 31 20:01:29.399672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 122/243] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:29 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:30.420414 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-465ec036-fba9-439b-b7b3-f22d5ff5f1ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:30.421010 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-465ec036-fba9-439b-b7b3-f22d5ff5f1ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:30.427251 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-465ec036-fba9-439b-b7b3-f22d5ff5f1ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:30.427689 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-465ec036-fba9-439b-b7b3-f22d5ff5f1ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:30.428565 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-465ec036-fba9-439b-b7b3-f22d5ff5f1ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:30.428993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-465ec036-fba9-439b-b7b3-f22d5ff5f1ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:30.566984 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-465ec036-fba9-439b-b7b3-f22d5ff5f1ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:30.574817 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-465ec036-fba9-439b-b7b3-f22d5ff5f1ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.158689 Jul 31 20:01:30.575515 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 122/244] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:30 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:30.777833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-331b8c8e-90e2-4b15-8999-0b54bcc6d342 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f71fa441-f59a-4baa-a29c-715824bb83cb"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:01:30.780308 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-331b8c8e-90e2-4b15-8999-0b54bcc6d342 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:30.787011 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-331b8c8e-90e2-4b15-8999-0b54bcc6d342 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:30.787658 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-331b8c8e-90e2-4b15-8999-0b54bcc6d342 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:30.788454 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-331b8c8e-90e2-4b15-8999-0b54bcc6d342 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:30.788884 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-331b8c8e-90e2-4b15-8999-0b54bcc6d342 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:31.109294 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-331b8c8e-90e2-4b15-8999-0b54bcc6d342 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "POST /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334796 Jul 31 20:01:31.109900 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 123/245] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:01:30 2022] POST /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:01:31.588059 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b30c12d5-0e77-4d92-bafe-1e1f71064013 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:31.588636 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b30c12d5-0e77-4d92-bafe-1e1f71064013 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:31.595157 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b30c12d5-0e77-4d92-bafe-1e1f71064013 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:31.595602 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b30c12d5-0e77-4d92-bafe-1e1f71064013 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:31.596360 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b30c12d5-0e77-4d92-bafe-1e1f71064013 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:31.596783 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b30c12d5-0e77-4d92-bafe-1e1f71064013 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:31.597639 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a4a6b87f-c40b-4fde-b125-a18a762ca96d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:31.598412 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a4a6b87f-c40b-4fde-b125-a18a762ca96d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:31.605127 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4a6b87f-c40b-4fde-b125-a18a762ca96d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:31.605600 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4a6b87f-c40b-4fde-b125-a18a762ca96d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:31.606544 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4a6b87f-c40b-4fde-b125-a18a762ca96d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:31.606972 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4a6b87f-c40b-4fde-b125-a18a762ca96d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:31.621016 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b30c12d5-0e77-4d92-bafe-1e1f71064013 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/ips" status: 200 len: 145 microversion: 2.1 time: 0.037111 Jul 31 20:01:31.621623 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 123/246] 10.222.0.48 () {58 vars in 1248 bytes} [Sun Jul 31 20:01:31 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:01:31.742248 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a4a6b87f-c40b-4fde-b125-a18a762ca96d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:31.751285 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a4a6b87f-c40b-4fde-b125-a18a762ca96d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.158720 Jul 31 20:01:31.751861 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 124/247] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:31 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:32.772549 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-22e13b6d-e470-40d7-9c26-387ec01a1208 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:32.773177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-22e13b6d-e470-40d7-9c26-387ec01a1208 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:32.779928 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22e13b6d-e470-40d7-9c26-387ec01a1208 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:32.780378 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22e13b6d-e470-40d7-9c26-387ec01a1208 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:32.781140 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22e13b6d-e470-40d7-9c26-387ec01a1208 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:32.781605 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22e13b6d-e470-40d7-9c26-387ec01a1208 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:32.914086 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-22e13b6d-e470-40d7-9c26-387ec01a1208 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:32.922339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-22e13b6d-e470-40d7-9c26-387ec01a1208 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.153723 Jul 31 20:01:32.923042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 124/248] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:32 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:33.943315 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-45d2b3d0-4507-4097-b1df-50638a3976f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:33.943916 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-45d2b3d0-4507-4097-b1df-50638a3976f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:33.951189 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-45d2b3d0-4507-4097-b1df-50638a3976f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:33.951633 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-45d2b3d0-4507-4097-b1df-50638a3976f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:33.952420 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-45d2b3d0-4507-4097-b1df-50638a3976f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:33.952853 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-45d2b3d0-4507-4097-b1df-50638a3976f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:34.090910 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-45d2b3d0-4507-4097-b1df-50638a3976f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:34.098901 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-45d2b3d0-4507-4097-b1df-50638a3976f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.159570 Jul 31 20:01:34.099485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 125/249] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:33 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:35.120614 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eae7b024-4543-480b-ac5c-8c5def68273f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:35.121261 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eae7b024-4543-480b-ac5c-8c5def68273f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:35.127688 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eae7b024-4543-480b-ac5c-8c5def68273f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:35.128140 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eae7b024-4543-480b-ac5c-8c5def68273f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:35.128905 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eae7b024-4543-480b-ac5c-8c5def68273f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:35.129349 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eae7b024-4543-480b-ac5c-8c5def68273f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:35.262892 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eae7b024-4543-480b-ac5c-8c5def68273f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:35.270423 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eae7b024-4543-480b-ac5c-8c5def68273f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.154131 Jul 31 20:01:35.270982 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 125/250] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:35 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:36.291366 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b0f0d50f-6e21-4ba4-9424-892751181406 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:36.292518 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b0f0d50f-6e21-4ba4-9424-892751181406 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:36.299345 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0f0d50f-6e21-4ba4-9424-892751181406 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:36.299795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0f0d50f-6e21-4ba4-9424-892751181406 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:36.300560 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0f0d50f-6e21-4ba4-9424-892751181406 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:36.300968 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0f0d50f-6e21-4ba4-9424-892751181406 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:36.325394 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:36.457182 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b0f0d50f-6e21-4ba4-9424-892751181406 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:36.482011 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b0f0d50f-6e21-4ba4-9424-892751181406 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.194398 Jul 31 20:01:36.496910 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 126/251] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:36 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:37.504748 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9bc1b672-d426-49cf-9de8-7372238219bb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:37.505370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9bc1b672-d426-49cf-9de8-7372238219bb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:37.514709 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bc1b672-d426-49cf-9de8-7372238219bb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:37.515260 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bc1b672-d426-49cf-9de8-7372238219bb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:37.516036 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bc1b672-d426-49cf-9de8-7372238219bb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:37.516466 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bc1b672-d426-49cf-9de8-7372238219bb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:37.620078 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-20727abc-9676-4dc1-91df-fdf55e6b1816 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "759587bb-0722-4710-9f06-09b802eed0bc"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:01:37.622551 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-20727abc-9676-4dc1-91df-fdf55e6b1816 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:37.630047 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20727abc-9676-4dc1-91df-fdf55e6b1816 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:37.630493 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20727abc-9676-4dc1-91df-fdf55e6b1816 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:37.631475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20727abc-9676-4dc1-91df-fdf55e6b1816 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:37.631910 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20727abc-9676-4dc1-91df-fdf55e6b1816 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:37.656598 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9bc1b672-d426-49cf-9de8-7372238219bb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:37.664717 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9bc1b672-d426-49cf-9de8-7372238219bb tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.164847 Jul 31 20:01:37.665309 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 126/252] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:37 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:37.928635 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-20727abc-9676-4dc1-91df-fdf55e6b1816 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "POST /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312891 Jul 31 20:01:37.929262 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 127/253] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:01:37 2022] POST /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:01:38.685781 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4a966a7-d5a9-404f-b4a8-847d5b41b69e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:38.686352 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d4a966a7-d5a9-404f-b4a8-847d5b41b69e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:38.692892 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4a966a7-d5a9-404f-b4a8-847d5b41b69e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:38.693372 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4a966a7-d5a9-404f-b4a8-847d5b41b69e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:38.694133 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4a966a7-d5a9-404f-b4a8-847d5b41b69e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:38.694552 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4a966a7-d5a9-404f-b4a8-847d5b41b69e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:38.834058 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d4a966a7-d5a9-404f-b4a8-847d5b41b69e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:38.843984 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d4a966a7-d5a9-404f-b4a8-847d5b41b69e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.162359 Jul 31 20:01:38.844617 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 127/254] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:38 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:39.865821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a011176b-416a-4984-a78d-3b08a7fe48f5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:39.866715 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a011176b-416a-4984-a78d-3b08a7fe48f5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:39.875070 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a011176b-416a-4984-a78d-3b08a7fe48f5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:39.875507 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a011176b-416a-4984-a78d-3b08a7fe48f5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:39.876318 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a011176b-416a-4984-a78d-3b08a7fe48f5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:39.876741 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a011176b-416a-4984-a78d-3b08a7fe48f5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:40.014134 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a011176b-416a-4984-a78d-3b08a7fe48f5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:40.022187 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a011176b-416a-4984-a78d-3b08a7fe48f5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.160841 Jul 31 20:01:40.022719 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 128/255] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:39 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:40.273064 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-db731f95-e4d5-4767-aa26-0683ec3cc428 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:40.273606 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-db731f95-e4d5-4767-aa26-0683ec3cc428 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:40.279768 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db731f95-e4d5-4767-aa26-0683ec3cc428 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:40.280235 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db731f95-e4d5-4767-aa26-0683ec3cc428 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:40.280986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db731f95-e4d5-4767-aa26-0683ec3cc428 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:40.281442 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db731f95-e4d5-4767-aa26-0683ec3cc428 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:40.304754 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-db731f95-e4d5-4767-aa26-0683ec3cc428 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/ips" status: 200 len: 153 microversion: 2.20 time: 0.037225 Jul 31 20:01:40.308653 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 128/256] 10.222.0.48 () {60 vars in 1289 bytes} [Sun Jul 31 20:01:40 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 20:01:41.044558 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0e5ac75f-10d6-4f14-8cd9-84927fe56239 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:41.045184 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0e5ac75f-10d6-4f14-8cd9-84927fe56239 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:41.052224 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e5ac75f-10d6-4f14-8cd9-84927fe56239 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:41.052659 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e5ac75f-10d6-4f14-8cd9-84927fe56239 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:41.053538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e5ac75f-10d6-4f14-8cd9-84927fe56239 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:41.053969 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e5ac75f-10d6-4f14-8cd9-84927fe56239 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:41.188235 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0e5ac75f-10d6-4f14-8cd9-84927fe56239 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:41.196176 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0e5ac75f-10d6-4f14-8cd9-84927fe56239 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.156602 Jul 31 20:01:41.196735 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 129/257] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:41 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:42.217288 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d7dcacee-8adf-40d0-a8ca-bf360bb8dd90 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:42.217865 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d7dcacee-8adf-40d0-a8ca-bf360bb8dd90 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:42.224163 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7dcacee-8adf-40d0-a8ca-bf360bb8dd90 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:42.224625 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7dcacee-8adf-40d0-a8ca-bf360bb8dd90 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:42.225726 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7dcacee-8adf-40d0-a8ca-bf360bb8dd90 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:42.226143 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7dcacee-8adf-40d0-a8ca-bf360bb8dd90 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:42.379077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d7dcacee-8adf-40d0-a8ca-bf360bb8dd90 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:42.386600 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d7dcacee-8adf-40d0-a8ca-bf360bb8dd90 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.173404 Jul 31 20:01:42.387167 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 129/258] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:42 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:42.609218 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f0d9388f-4cee-4a00-becf-f80b1e50d687 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:01:42.609873 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f0d9388f-4cee-4a00-becf-f80b1e50d687 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:42.617074 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0d9388f-4cee-4a00-becf-f80b1e50d687 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:42.617561 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0d9388f-4cee-4a00-becf-f80b1e50d687 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:42.618325 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0d9388f-4cee-4a00-becf-f80b1e50d687 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:42.618753 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0d9388f-4cee-4a00-becf-f80b1e50d687 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:42.641613 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-f0d9388f-4cee-4a00-becf-f80b1e50d687 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lazy-loading 'flavor' on Instance uuid cdb0b91c-9a78-49a1-a96b-016c09759655 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:01:42.972216 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-24984fda-fe5d-4273-9dca-e1fd72a9e983 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Action: 'create', calling method: .version_select at 0x7ffa249c75e0>, body: {"keypair": {"name": "tempest-keypair-1333098639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfnOp4Ys7q8YJ1+lfWNjSMb2HkPc84mlx7T8N2vmAh37toIQXvtv2Hg6iHXskST5AN6QmH4y57UyPcSScZVygaUMgAy0WEu7nmVtsagAIHAAOVYf1vz0vpIMluFkS30eA=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:01:42.988915 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-24984fda-fe5d-4273-9dca-e1fd72a9e983 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for project 2f435e60769a43deb3c15b351f97d62c. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:01:42.992770 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-24984fda-fe5d-4273-9dca-e1fd72a9e983 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for user 76b9c24c8dc94af8b2c8e44be8494e9b and project 2f435e60769a43deb3c15b351f97d62c. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:01:43.017449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-24984fda-fe5d-4273-9dca-e1fd72a9e983 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049159 Jul 31 20:01:43.018187 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 130/259] 10.222.0.48 () {60 vars in 1159 bytes} [Sun Jul 31 20:01:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:01:43.408094 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1eada1c2-5d79-4eb6-8632-de29c05d9d40 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:43.409021 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1eada1c2-5d79-4eb6-8632-de29c05d9d40 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:43.419296 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eada1c2-5d79-4eb6-8632-de29c05d9d40 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:43.419905 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eada1c2-5d79-4eb6-8632-de29c05d9d40 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:43.421100 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eada1c2-5d79-4eb6-8632-de29c05d9d40 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:43.423725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eada1c2-5d79-4eb6-8632-de29c05d9d40 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:43.588530 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1eada1c2-5d79-4eb6-8632-de29c05d9d40 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:43.597415 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1eada1c2-5d79-4eb6-8632-de29c05d9d40 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.193335 Jul 31 20:01:43.598004 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 131/260] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:43 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:44.392398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1861570750", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "758cb11a-528c-4227-88a9-030f838941a5"}], "security_groups": [{"name": "tempest-securitygroup--1298309616"}], "key_name": "tempest-keypair-1333098639", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:01:46.396201 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f0d9388f-4cee-4a00-becf-f80b1e50d687 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "POST /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/action" status: 202 len: 0 microversion: 2.20 time: 3.793384 Jul 31 20:01:46.401640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 130/261] 10.222.0.48 () {62 vars in 1319 bytes} [Sun Jul 31 20:01:42 2022] POST /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/action => generated 0 bytes in 3796 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:01:46.404555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-989122ed-6bc8-485d-b5db-3ac3fc821dec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:46.405436 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-989122ed-6bc8-485d-b5db-3ac3fc821dec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:46.414111 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-989122ed-6bc8-485d-b5db-3ac3fc821dec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:46.415699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-989122ed-6bc8-485d-b5db-3ac3fc821dec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:46.416151 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-989122ed-6bc8-485d-b5db-3ac3fc821dec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:46.416422 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-989122ed-6bc8-485d-b5db-3ac3fc821dec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:46.478816 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] validate_networks() for [('758cb11a-528c-4227-88a9-030f838941a5', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:01:46.647445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-989122ed-6bc8-485d-b5db-3ac3fc821dec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:46.658933 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-989122ed-6bc8-485d-b5db-3ac3fc821dec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.259012 Jul 31 20:01:46.659741 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 131/262] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:46 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:46.664599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-854592132", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1052386514", "security_groups": [{"name": "tempest-secgroup-smoke-1065349258"}], "block_device_mapping_v2": [{"uuid": "ea90646e-bd0d-4bc7-bd2d-5b99589dad91", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4ede3dd9-1e02-435f-a555-c3b09c614bb8"}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:01:46.844285 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] validate_networks() for [('4ede3dd9-1e02-435f-a555-c3b09c614bb8', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:01:47.061271 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:01:47.063803 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:01:47.064277 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:01:47.064718 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:01:47.065121 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:01:47.079954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:47.080552 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:47.081483 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:47.084363 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:47.101715 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for project 2f435e60769a43deb3c15b351f97d62c. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:01:47.105535 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for user 76b9c24c8dc94af8b2c8e44be8494e9b and project 2f435e60769a43deb3c15b351f97d62c. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:01:47.117052 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:01:47.120016 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:01:47.170065 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a90d4880-e49a-46fb-ade4-1a69750bd5a4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.781924 Jul 31 20:01:47.171125 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 132/263] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:01:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 2784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:01:47.175992 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b395927b-6096-41a3-972d-7eec160687f8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:47.176931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b395927b-6096-41a3-972d-7eec160687f8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:47.183949 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b395927b-6096-41a3-972d-7eec160687f8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:47.184486 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b395927b-6096-41a3-972d-7eec160687f8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:47.185358 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b395927b-6096-41a3-972d-7eec160687f8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:47.186004 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b395927b-6096-41a3-972d-7eec160687f8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:47.396914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b395927b-6096-41a3-972d-7eec160687f8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:47.406927 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b395927b-6096-41a3-972d-7eec160687f8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:47.408849 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b395927b-6096-41a3-972d-7eec160687f8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:47.414062 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:01:47.414582 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:01:47.414924 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:01:47.415318 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:01:47.415779 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:01:47.418414 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b395927b-6096-41a3-972d-7eec160687f8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.237975 Jul 31 20:01:47.419061 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 133/264] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:01:47 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:01:47.424555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:47.425057 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:47.426042 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:47.426470 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:47.432555 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-46201484-ceaa-47eb-9820-4126992c9490 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:47.433174 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-46201484-ceaa-47eb-9820-4126992c9490 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:47.446486 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Getting quotas for project 15e426e0b2bd4bc29e7a8e222fcc8f7e. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:01:47.450503 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Getting quotas for user c6d7c6c7a3b5413c9c8d5c1e69d9db4c and project 15e426e0b2bd4bc29e7a8e222fcc8f7e. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:01:47.506733 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-46201484-ceaa-47eb-9820-4126992c9490 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:47.520517 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-46201484-ceaa-47eb-9820-4126992c9490 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1242 microversion: 2.1 time: 0.100362 Jul 31 20:01:47.522981 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 134/265] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:47 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:47.528943 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:01:47.532071 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea90646e-bd0d-4bc7-bd2d-5b99589dad91',volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:01:47.673259 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-61d886e4-9da9-49a7-b66f-67f4441cf03b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.012310 Jul 31 20:01:47.683475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 132/266] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:01:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:01:47.683694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2e56fd13-f989-4fff-a1d3-8710d1436e48 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:47.683694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2e56fd13-f989-4fff-a1d3-8710d1436e48 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:47.693074 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e56fd13-f989-4fff-a1d3-8710d1436e48 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:47.697501 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5b5f40a9-7c67-42c2-a84a-a4a84ff70797 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:47.697705 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e56fd13-f989-4fff-a1d3-8710d1436e48 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:47.698710 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5b5f40a9-7c67-42c2-a84a-a4a84ff70797 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:47.698864 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e56fd13-f989-4fff-a1d3-8710d1436e48 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:47.699295 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e56fd13-f989-4fff-a1d3-8710d1436e48 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:47.803668 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5b5f40a9-7c67-42c2-a84a-a4a84ff70797 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:47.812754 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5b5f40a9-7c67-42c2-a84a-a4a84ff70797 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1094 microversion: 2.1 time: 0.124699 Jul 31 20:01:47.813687 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 133/267] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:47 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1094 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:47.886251 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2e56fd13-f989-4fff-a1d3-8710d1436e48 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:47.894357 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2e56fd13-f989-4fff-a1d3-8710d1436e48 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.218364 Jul 31 20:01:47.895060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 135/268] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:47 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:01:48.442920 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f88b0beb-f1a0-4c48-aac1-6d8ee5c3c849 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:48.443491 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f88b0beb-f1a0-4c48-aac1-6d8ee5c3c849 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:48.450426 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f88b0beb-f1a0-4c48-aac1-6d8ee5c3c849 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:48.450870 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f88b0beb-f1a0-4c48-aac1-6d8ee5c3c849 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:48.451625 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f88b0beb-f1a0-4c48-aac1-6d8ee5c3c849 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:48.452047 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f88b0beb-f1a0-4c48-aac1-6d8ee5c3c849 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:48.548966 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6795f404-3890-41a7-a912-b1f29c92927c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:48.549717 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6795f404-3890-41a7-a912-b1f29c92927c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:48.557020 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6795f404-3890-41a7-a912-b1f29c92927c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:48.559688 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6795f404-3890-41a7-a912-b1f29c92927c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:48.562257 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6795f404-3890-41a7-a912-b1f29c92927c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:48.562257 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6795f404-3890-41a7-a912-b1f29c92927c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:48.621747 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f88b0beb-f1a0-4c48-aac1-6d8ee5c3c849 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:48.630329 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f88b0beb-f1a0-4c48-aac1-6d8ee5c3c849 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:48.631881 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f88b0beb-f1a0-4c48-aac1-6d8ee5c3c849 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:48.633233 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f88b0beb-f1a0-4c48-aac1-6d8ee5c3c849 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.194189 Jul 31 20:01:48.634478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 134/269] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:01:48 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:01:48.638574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6795f404-3890-41a7-a912-b1f29c92927c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:48.646842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6795f404-3890-41a7-a912-b1f29c92927c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1302 microversion: 2.1 time: 0.107581 Jul 31 20:01:48.652441 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 136/270] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:48 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1302 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:48.837793 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e94b4ba8-27fe-4bf5-8993-41c811b7fdc6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:48.838481 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e94b4ba8-27fe-4bf5-8993-41c811b7fdc6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:48.849976 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e94b4ba8-27fe-4bf5-8993-41c811b7fdc6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:48.850495 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e94b4ba8-27fe-4bf5-8993-41c811b7fdc6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:48.851274 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e94b4ba8-27fe-4bf5-8993-41c811b7fdc6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:48.851701 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e94b4ba8-27fe-4bf5-8993-41c811b7fdc6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:48.916653 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1da93247-c6dc-4c70-a899-df7888eec2f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:48.917555 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1da93247-c6dc-4c70-a899-df7888eec2f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:48.922435 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e94b4ba8-27fe-4bf5-8993-41c811b7fdc6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:48.924275 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1da93247-c6dc-4c70-a899-df7888eec2f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:48.924717 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1da93247-c6dc-4c70-a899-df7888eec2f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:48.925663 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1da93247-c6dc-4c70-a899-df7888eec2f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:48.926070 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1da93247-c6dc-4c70-a899-df7888eec2f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:48.931132 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e94b4ba8-27fe-4bf5-8993-41c811b7fdc6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1136 microversion: 2.1 time: 0.100023 Jul 31 20:01:48.932226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 135/271] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:48 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1136 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:48.948405 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:49.072161 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1da93247-c6dc-4c70-a899-df7888eec2f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:49.079844 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1da93247-c6dc-4c70-a899-df7888eec2f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.167373 Jul 31 20:01:49.080396 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 137/272] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:48 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:01:49.657601 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b8836a05-61c0-440b-81db-cac4f2099ffa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:49.658518 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b8836a05-61c0-440b-81db-cac4f2099ffa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:49.668404 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d0fb303f-c1d1-4932-b6e7-b15c79deba92 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:49.668882 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8836a05-61c0-440b-81db-cac4f2099ffa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:49.669213 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8836a05-61c0-440b-81db-cac4f2099ffa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:49.670056 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d0fb303f-c1d1-4932-b6e7-b15c79deba92 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:49.671870 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8836a05-61c0-440b-81db-cac4f2099ffa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:49.672343 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8836a05-61c0-440b-81db-cac4f2099ffa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:49.679540 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0fb303f-c1d1-4932-b6e7-b15c79deba92 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:49.680236 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0fb303f-c1d1-4932-b6e7-b15c79deba92 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:49.681249 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0fb303f-c1d1-4932-b6e7-b15c79deba92 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:49.681847 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0fb303f-c1d1-4932-b6e7-b15c79deba92 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:49.764764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d0fb303f-c1d1-4932-b6e7-b15c79deba92 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:49.772512 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d0fb303f-c1d1-4932-b6e7-b15c79deba92 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1300 microversion: 2.1 time: 0.108445 Jul 31 20:01:49.773103 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 138/273] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:49 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:49.878523 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b8836a05-61c0-440b-81db-cac4f2099ffa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:49.890980 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b8836a05-61c0-440b-81db-cac4f2099ffa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:49.892640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b8836a05-61c0-440b-81db-cac4f2099ffa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:49.894286 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b8836a05-61c0-440b-81db-cac4f2099ffa tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.241076 Jul 31 20:01:49.894976 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 136/274] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:01:49 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:01:49.953518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-093b3719-a188-4e59-b71e-537fb8ec1ad0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:49.954135 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-093b3719-a188-4e59-b71e-537fb8ec1ad0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:49.960989 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093b3719-a188-4e59-b71e-537fb8ec1ad0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:49.961459 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093b3719-a188-4e59-b71e-537fb8ec1ad0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:49.962223 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093b3719-a188-4e59-b71e-537fb8ec1ad0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:49.962659 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093b3719-a188-4e59-b71e-537fb8ec1ad0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:50.038941 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-093b3719-a188-4e59-b71e-537fb8ec1ad0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:50.049471 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-093b3719-a188-4e59-b71e-537fb8ec1ad0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1192 microversion: 2.1 time: 0.099020 Jul 31 20:01:50.050583 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 139/275] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:49 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1192 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:50.100470 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-385d18fb-cabf-49cb-b18d-dbb77b8e9691 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:50.101069 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-385d18fb-cabf-49cb-b18d-dbb77b8e9691 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:50.107448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-385d18fb-cabf-49cb-b18d-dbb77b8e9691 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:50.107886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-385d18fb-cabf-49cb-b18d-dbb77b8e9691 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:50.108653 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-385d18fb-cabf-49cb-b18d-dbb77b8e9691 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:50.109077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-385d18fb-cabf-49cb-b18d-dbb77b8e9691 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:50.590739 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-385d18fb-cabf-49cb-b18d-dbb77b8e9691 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:50.598475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-385d18fb-cabf-49cb-b18d-dbb77b8e9691 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.502163 Jul 31 20:01:50.599075 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 137/276] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:50 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:50.797820 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e72e6ddd-2585-4ab4-89e0-5ec587a11447 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:50.798700 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e72e6ddd-2585-4ab4-89e0-5ec587a11447 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:50.809948 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e72e6ddd-2585-4ab4-89e0-5ec587a11447 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:50.809948 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e72e6ddd-2585-4ab4-89e0-5ec587a11447 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:50.809948 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e72e6ddd-2585-4ab4-89e0-5ec587a11447 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:50.809948 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e72e6ddd-2585-4ab4-89e0-5ec587a11447 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:50.890944 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9c41dd69-8105-427b-ac75-83e4445845e1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:01:50.897533 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9c41dd69-8105-427b-ac75-83e4445845e1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:50.897976 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9c41dd69-8105-427b-ac75-83e4445845e1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:50.937262 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e72e6ddd-2585-4ab4-89e0-5ec587a11447 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:50.945176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e72e6ddd-2585-4ab4-89e0-5ec587a11447 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1300 microversion: 2.1 time: 0.155008 Jul 31 20:01:50.946233 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 140/277] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:50 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1300 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:50.951161 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c83ecf1b-3039-4e77-a817-00c104a4df32 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:50.951965 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c83ecf1b-3039-4e77-a817-00c104a4df32 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:50.958277 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c83ecf1b-3039-4e77-a817-00c104a4df32 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:50.959012 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c83ecf1b-3039-4e77-a817-00c104a4df32 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:50.960073 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c83ecf1b-3039-4e77-a817-00c104a4df32 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:50.960671 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c83ecf1b-3039-4e77-a817-00c104a4df32 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:50.961797 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9c41dd69-8105-427b-ac75-83e4445845e1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Going to try to stop instance {{(pid=117919) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 20:01:51.012768 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9c41dd69-8105-427b-ac75-83e4445845e1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "POST /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/action" status: 202 len: 0 microversion: 2.1 time: 0.125551 Jul 31 20:01:51.013518 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 138/278] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:01:50 2022] POST /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 20:01:51.022092 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5a940538-0c2f-45ec-87ca-725d0ac79caa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:51.022853 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5a940538-0c2f-45ec-87ca-725d0ac79caa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:51.029635 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a940538-0c2f-45ec-87ca-725d0ac79caa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:51.030387 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a940538-0c2f-45ec-87ca-725d0ac79caa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:51.031348 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a940538-0c2f-45ec-87ca-725d0ac79caa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:51.031780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a940538-0c2f-45ec-87ca-725d0ac79caa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:51.325873 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c83ecf1b-3039-4e77-a817-00c104a4df32 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:51.335000 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c83ecf1b-3039-4e77-a817-00c104a4df32 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:51.336521 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c83ecf1b-3039-4e77-a817-00c104a4df32 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:51.337706 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c83ecf1b-3039-4e77-a817-00c104a4df32 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.390325 Jul 31 20:01:51.347683 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 141/279] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:01:50 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:01:51.347683 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-641b96bc-84f2-4aaa-8b5e-7dd14e646b62 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:51.347683 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-641b96bc-84f2-4aaa-8b5e-7dd14e646b62 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:51.352949 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-641b96bc-84f2-4aaa-8b5e-7dd14e646b62 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:51.353430 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-641b96bc-84f2-4aaa-8b5e-7dd14e646b62 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:51.354641 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-641b96bc-84f2-4aaa-8b5e-7dd14e646b62 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:51.355094 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-641b96bc-84f2-4aaa-8b5e-7dd14e646b62 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:51.396116 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5a940538-0c2f-45ec-87ca-725d0ac79caa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:51.404653 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5a940538-0c2f-45ec-87ca-725d0ac79caa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.386605 Jul 31 20:01:51.405800 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 139/280] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:51 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:01:51.476357 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-641b96bc-84f2-4aaa-8b5e-7dd14e646b62 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:51.491794 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-641b96bc-84f2-4aaa-8b5e-7dd14e646b62 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1210 microversion: 2.1 time: 0.152460 Jul 31 20:01:51.497631 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 142/281] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:51 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1210 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:51.621233 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cdef6e58-e3ca-44e9-89d2-1167b855b9ec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:51.622882 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cdef6e58-e3ca-44e9-89d2-1167b855b9ec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:51.630987 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cdef6e58-e3ca-44e9-89d2-1167b855b9ec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:51.631736 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cdef6e58-e3ca-44e9-89d2-1167b855b9ec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:51.632722 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cdef6e58-e3ca-44e9-89d2-1167b855b9ec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:51.633338 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cdef6e58-e3ca-44e9-89d2-1167b855b9ec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:51.638620 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:51.930649 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cdef6e58-e3ca-44e9-89d2-1167b855b9ec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:51.939212 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cdef6e58-e3ca-44e9-89d2-1167b855b9ec tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.323485 Jul 31 20:01:51.939830 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 140/282] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:51 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:51.965901 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-707aacd6-8496-4f11-99f0-e0d74237c6ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:51.966609 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-707aacd6-8496-4f11-99f0-e0d74237c6ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:51.972749 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-707aacd6-8496-4f11-99f0-e0d74237c6ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:51.973302 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-707aacd6-8496-4f11-99f0-e0d74237c6ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:51.974118 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-707aacd6-8496-4f11-99f0-e0d74237c6ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:51.974609 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-707aacd6-8496-4f11-99f0-e0d74237c6ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:52.309619 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-707aacd6-8496-4f11-99f0-e0d74237c6ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:52.318281 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-707aacd6-8496-4f11-99f0-e0d74237c6ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1368 microversion: 2.1 time: 0.356190 Jul 31 20:01:52.319094 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 143/283] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:51 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1368 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:52.360812 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b5613fc8-7feb-4e4b-b929-cb25294cba19 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:52.362047 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b5613fc8-7feb-4e4b-b929-cb25294cba19 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:52.375367 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5613fc8-7feb-4e4b-b929-cb25294cba19 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:52.376945 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5613fc8-7feb-4e4b-b929-cb25294cba19 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:52.377912 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5613fc8-7feb-4e4b-b929-cb25294cba19 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:52.378427 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5613fc8-7feb-4e4b-b929-cb25294cba19 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:52.426966 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cd581392-5a80-404e-973d-d73d6baf60c5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:52.427557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cd581392-5a80-404e-973d-d73d6baf60c5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:52.433718 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd581392-5a80-404e-973d-d73d6baf60c5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:52.434157 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd581392-5a80-404e-973d-d73d6baf60c5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:52.434927 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd581392-5a80-404e-973d-d73d6baf60c5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:52.435346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd581392-5a80-404e-973d-d73d6baf60c5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:52.829808 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b5613fc8-7feb-4e4b-b929-cb25294cba19 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:52.844879 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b5613fc8-7feb-4e4b-b929-cb25294cba19 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:52.849052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b5613fc8-7feb-4e4b-b929-cb25294cba19 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:52.851369 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b5613fc8-7feb-4e4b-b929-cb25294cba19 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.495047 Jul 31 20:01:52.852761 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 141/284] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:01:52 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:01:52.858071 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1ffa3306-b354-487b-bb76-e4a493dc950a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:52.858848 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1ffa3306-b354-487b-bb76-e4a493dc950a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:52.870428 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ffa3306-b354-487b-bb76-e4a493dc950a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:52.870921 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ffa3306-b354-487b-bb76-e4a493dc950a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:52.876490 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ffa3306-b354-487b-bb76-e4a493dc950a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:52.877235 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ffa3306-b354-487b-bb76-e4a493dc950a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:52.885024 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cd581392-5a80-404e-973d-d73d6baf60c5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:52.899067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cd581392-5a80-404e-973d-d73d6baf60c5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.476114 Jul 31 20:01:52.899852 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 144/285] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:52 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:01:52.960632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-86a91b16-5978-47e1-aa60-4862f26ed54d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:52.961381 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-86a91b16-5978-47e1-aa60-4862f26ed54d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:52.967570 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86a91b16-5978-47e1-aa60-4862f26ed54d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:52.968223 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86a91b16-5978-47e1-aa60-4862f26ed54d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:52.969023 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86a91b16-5978-47e1-aa60-4862f26ed54d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:52.969478 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86a91b16-5978-47e1-aa60-4862f26ed54d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:53.623043 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1ffa3306-b354-487b-bb76-e4a493dc950a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:53.631752 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1ffa3306-b354-487b-bb76-e4a493dc950a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.777339 Jul 31 20:01:53.632341 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 142/286] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:52 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:53.647833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-d5f011a3-211f-4a70-8ac1-2608070115c5 req-5dcbf92e-9c5d-4082-b848-36822304dc7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feed8b88-8df9-44a5-9520-0d723924fd1d", "tag": "d1dea7a4-f82d-4a04-9a13-0e5ac255e8b3"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:01:53.653396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:53.666038 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d5f011a3-211f-4a70-8ac1-2608070115c5 req-5dcbf92e-9c5d-4082-b848-36822304dc7b service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:53.666754 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-86a91b16-5978-47e1-aa60-4862f26ed54d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:53.667267 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d5f011a3-211f-4a70-8ac1-2608070115c5 req-5dcbf92e-9c5d-4082-b848-36822304dc7b service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:53.678973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-86a91b16-5978-47e1-aa60-4862f26ed54d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.722373 Jul 31 20:01:53.680781 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 145/287] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:52 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:01:53.681271 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-d5f011a3-211f-4a70-8ac1-2608070115c5 req-5dcbf92e-9c5d-4082-b848-36822304dc7b service nova] Creating event network-changed:d1dea7a4-f82d-4a04-9a13-0e5ac255e8b3 for instance feed8b88-8df9-44a5-9520-0d723924fd1d on hv-cinder-84984 Jul 31 20:01:53.686515 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-d5f011a3-211f-4a70-8ac1-2608070115c5 req-5dcbf92e-9c5d-4082-b848-36822304dc7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052947 Jul 31 20:01:53.687417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 143/288] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:01:53.694029 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7c0b1a62-4240-400b-b69f-122ab28b22f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:53.694646 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7c0b1a62-4240-400b-b69f-122ab28b22f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:53.700914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c0b1a62-4240-400b-b69f-122ab28b22f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:53.701399 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c0b1a62-4240-400b-b69f-122ab28b22f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:53.702322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c0b1a62-4240-400b-b69f-122ab28b22f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:53.702754 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c0b1a62-4240-400b-b69f-122ab28b22f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:53.878725 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b3f2be28-6166-476f-9af9-336448f7e988 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:53.879418 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b3f2be28-6166-476f-9af9-336448f7e988 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:53.886420 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3f2be28-6166-476f-9af9-336448f7e988 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:53.886829 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3f2be28-6166-476f-9af9-336448f7e988 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:53.887585 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3f2be28-6166-476f-9af9-336448f7e988 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:53.888018 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3f2be28-6166-476f-9af9-336448f7e988 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:54.024615 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7c0b1a62-4240-400b-b69f-122ab28b22f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:54.034444 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7c0b1a62-4240-400b-b69f-122ab28b22f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1368 microversion: 2.1 time: 0.352124 Jul 31 20:01:54.035992 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 146/289] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:53 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1368 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:54.040846 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-876a3593-1c5f-4cf5-9c71-dca6175f1b92 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:54.041475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-876a3593-1c5f-4cf5-9c71-dca6175f1b92 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:54.047614 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-876a3593-1c5f-4cf5-9c71-dca6175f1b92 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:54.048061 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-876a3593-1c5f-4cf5-9c71-dca6175f1b92 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:54.048861 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-876a3593-1c5f-4cf5-9c71-dca6175f1b92 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:54.049339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-876a3593-1c5f-4cf5-9c71-dca6175f1b92 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:54.341792 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b3f2be28-6166-476f-9af9-336448f7e988 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:54.352050 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b3f2be28-6166-476f-9af9-336448f7e988 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:54.353698 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b3f2be28-6166-476f-9af9-336448f7e988 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:54.355017 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b3f2be28-6166-476f-9af9-336448f7e988 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.480835 Jul 31 20:01:54.355758 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 144/290] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:01:53 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:01:54.392101 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-876a3593-1c5f-4cf5-9c71-dca6175f1b92 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:54.400423 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-876a3593-1c5f-4cf5-9c71-dca6175f1b92 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.363313 Jul 31 20:01:54.400995 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 147/291] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:54 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:54.654903 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f9d6798b-0a18-4771-aac7-a67131d4c73d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:54.655615 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f9d6798b-0a18-4771-aac7-a67131d4c73d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:54.661990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9d6798b-0a18-4771-aac7-a67131d4c73d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:54.662444 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9d6798b-0a18-4771-aac7-a67131d4c73d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:54.663213 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9d6798b-0a18-4771-aac7-a67131d4c73d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:54.663650 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9d6798b-0a18-4771-aac7-a67131d4c73d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:54.707173 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a9e7be08-db66-4543-ab7b-b24939fb0ef5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:54.708573 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a9e7be08-db66-4543-ab7b-b24939fb0ef5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:54.715522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9e7be08-db66-4543-ab7b-b24939fb0ef5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:54.716118 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9e7be08-db66-4543-ab7b-b24939fb0ef5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:54.717076 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9e7be08-db66-4543-ab7b-b24939fb0ef5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:54.717616 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9e7be08-db66-4543-ab7b-b24939fb0ef5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:54.883401 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f9d6798b-0a18-4771-aac7-a67131d4c73d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:54.891014 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f9d6798b-0a18-4771-aac7-a67131d4c73d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.241190 Jul 31 20:01:54.891898 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 145/292] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:54 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:54.904845 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a9e7be08-db66-4543-ab7b-b24939fb0ef5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:54.912804 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a9e7be08-db66-4543-ab7b-b24939fb0ef5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.214361 Jul 31 20:01:54.913344 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 148/293] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:54 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:55.056094 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-dc4aeea0-dec7-4b08-8c3d-ccb1a2dbf525 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:55.056724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-dc4aeea0-dec7-4b08-8c3d-ccb1a2dbf525 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:55.063466 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dc4aeea0-dec7-4b08-8c3d-ccb1a2dbf525 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:55.063922 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dc4aeea0-dec7-4b08-8c3d-ccb1a2dbf525 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:55.064680 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dc4aeea0-dec7-4b08-8c3d-ccb1a2dbf525 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:55.065121 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dc4aeea0-dec7-4b08-8c3d-ccb1a2dbf525 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:55.212577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dc4aeea0-dec7-4b08-8c3d-ccb1a2dbf525 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:55.220772 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-dc4aeea0-dec7-4b08-8c3d-ccb1a2dbf525 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1368 microversion: 2.1 time: 0.168473 Jul 31 20:01:55.221043 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 146/294] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:55 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:55.379301 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c8014687-14df-4789-a2a2-02f6210295c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:55.379958 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c8014687-14df-4789-a2a2-02f6210295c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:55.399997 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8014687-14df-4789-a2a2-02f6210295c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:55.400685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8014687-14df-4789-a2a2-02f6210295c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:55.401952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8014687-14df-4789-a2a2-02f6210295c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:55.402575 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8014687-14df-4789-a2a2-02f6210295c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:55.421741 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ad7657a0-d74d-4b2d-8087-635a1dce1f51 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:55.422254 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ad7657a0-d74d-4b2d-8087-635a1dce1f51 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:55.428488 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad7657a0-d74d-4b2d-8087-635a1dce1f51 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:55.429190 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad7657a0-d74d-4b2d-8087-635a1dce1f51 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:55.429958 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad7657a0-d74d-4b2d-8087-635a1dce1f51 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:55.430384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad7657a0-d74d-4b2d-8087-635a1dce1f51 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:55.600372 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c8014687-14df-4789-a2a2-02f6210295c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:55.609402 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c8014687-14df-4789-a2a2-02f6210295c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:55.611119 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c8014687-14df-4789-a2a2-02f6210295c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:55.612243 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c8014687-14df-4789-a2a2-02f6210295c3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.237015 Jul 31 20:01:55.613978 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 149/295] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:01:55 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:01:55.615849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ad7657a0-d74d-4b2d-8087-635a1dce1f51 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:55.624514 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ad7657a0-d74d-4b2d-8087-635a1dce1f51 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.206770 Jul 31 20:01:55.625135 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 147/296] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:55 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:01:55.707413 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1de73d55-f473-4417-ba95-1f027c37247a req-39beedb4-761d-4046-be7a-d04487a87cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0dc439c-b3b3-443c-8680-f7b1623dbe29", "tag": "63e21ff2-2376-43b2-97f2-7343a4970d01"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:01:55.722113 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1de73d55-f473-4417-ba95-1f027c37247a req-39beedb4-761d-4046-be7a-d04487a87cda service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:55.722750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1de73d55-f473-4417-ba95-1f027c37247a req-39beedb4-761d-4046-be7a-d04487a87cda service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:55.736084 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1de73d55-f473-4417-ba95-1f027c37247a req-39beedb4-761d-4046-be7a-d04487a87cda service nova] Creating event network-changed:63e21ff2-2376-43b2-97f2-7343a4970d01 for instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 on hv-cinder-84984 Jul 31 20:01:55.741140 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1de73d55-f473-4417-ba95-1f027c37247a req-39beedb4-761d-4046-be7a-d04487a87cda service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041614 Jul 31 20:01:55.741760 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 150/297] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:01:55.912046 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-51ee6e61-1e13-49bf-8ec1-9732202f24d7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:55.912714 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-51ee6e61-1e13-49bf-8ec1-9732202f24d7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:55.918915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51ee6e61-1e13-49bf-8ec1-9732202f24d7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:55.919357 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51ee6e61-1e13-49bf-8ec1-9732202f24d7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:55.920107 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51ee6e61-1e13-49bf-8ec1-9732202f24d7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:55.920589 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51ee6e61-1e13-49bf-8ec1-9732202f24d7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:55.934121 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bc1ba585-36c8-4950-baf6-10fa2502eb7d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:55.934904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bc1ba585-36c8-4950-baf6-10fa2502eb7d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:55.941898 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc1ba585-36c8-4950-baf6-10fa2502eb7d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:55.942420 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc1ba585-36c8-4950-baf6-10fa2502eb7d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:55.943319 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc1ba585-36c8-4950-baf6-10fa2502eb7d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:55.943794 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc1ba585-36c8-4950-baf6-10fa2502eb7d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:56.130783 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-51ee6e61-1e13-49bf-8ec1-9732202f24d7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:56.133800 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bc1ba585-36c8-4950-baf6-10fa2502eb7d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:56.138615 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-51ee6e61-1e13-49bf-8ec1-9732202f24d7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.230691 Jul 31 20:01:56.139156 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 148/298] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:55 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:56.141422 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bc1ba585-36c8-4950-baf6-10fa2502eb7d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.211517 Jul 31 20:01:56.141976 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 151/299] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:55 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:56.245604 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cde0fc4b-9a68-4dcd-8ead-2d1b01310022 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:56.246592 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cde0fc4b-9a68-4dcd-8ead-2d1b01310022 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:56.257924 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cde0fc4b-9a68-4dcd-8ead-2d1b01310022 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:56.258704 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cde0fc4b-9a68-4dcd-8ead-2d1b01310022 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:56.259963 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cde0fc4b-9a68-4dcd-8ead-2d1b01310022 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:56.260396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cde0fc4b-9a68-4dcd-8ead-2d1b01310022 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:56.402494 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cde0fc4b-9a68-4dcd-8ead-2d1b01310022 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:56.410675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cde0fc4b-9a68-4dcd-8ead-2d1b01310022 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1368 microversion: 2.1 time: 0.171904 Jul 31 20:01:56.411225 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 149/300] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:56 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:56.635873 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c3d99259-4595-43d5-b56d-43a44b091eba tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:56.636485 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c3d99259-4595-43d5-b56d-43a44b091eba tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:56.643417 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3d99259-4595-43d5-b56d-43a44b091eba tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:56.644112 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3d99259-4595-43d5-b56d-43a44b091eba tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:56.645081 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3d99259-4595-43d5-b56d-43a44b091eba tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:56.645714 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3d99259-4595-43d5-b56d-43a44b091eba tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:56.646970 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8b017655-b17c-4600-9e66-75c6e77033aa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:56.647941 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8b017655-b17c-4600-9e66-75c6e77033aa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:56.655931 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b017655-b17c-4600-9e66-75c6e77033aa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:56.656543 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b017655-b17c-4600-9e66-75c6e77033aa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:56.657760 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b017655-b17c-4600-9e66-75c6e77033aa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:56.658304 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b017655-b17c-4600-9e66-75c6e77033aa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:57.020475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8b017655-b17c-4600-9e66-75c6e77033aa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:57.024113 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c3d99259-4595-43d5-b56d-43a44b091eba tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:57.029333 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8b017655-b17c-4600-9e66-75c6e77033aa tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.386963 Jul 31 20:01:57.030077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 150/301] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:56 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:57.033745 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c3d99259-4595-43d5-b56d-43a44b091eba tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:57.035589 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c3d99259-4595-43d5-b56d-43a44b091eba tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:57.036398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c3d99259-4595-43d5-b56d-43a44b091eba tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.404522 Jul 31 20:01:57.037122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 152/302] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:01:56 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:01:57.162106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-41d26db9-26e8-4b86-af7a-13e3c980d340 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:57.162784 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-41d26db9-26e8-4b86-af7a-13e3c980d340 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:57.164750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:57.169294 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-36a614b8-08cb-42ad-b45e-3e2a1cc1f8d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:57.170142 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-36a614b8-08cb-42ad-b45e-3e2a1cc1f8d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:57.171753 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41d26db9-26e8-4b86-af7a-13e3c980d340 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:57.172284 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41d26db9-26e8-4b86-af7a-13e3c980d340 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:57.173337 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41d26db9-26e8-4b86-af7a-13e3c980d340 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:57.173935 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41d26db9-26e8-4b86-af7a-13e3c980d340 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:57.177457 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36a614b8-08cb-42ad-b45e-3e2a1cc1f8d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:57.178145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36a614b8-08cb-42ad-b45e-3e2a1cc1f8d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:57.179264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36a614b8-08cb-42ad-b45e-3e2a1cc1f8d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:57.180037 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36a614b8-08cb-42ad-b45e-3e2a1cc1f8d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:57.417370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-41d26db9-26e8-4b86-af7a-13e3c980d340 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:57.427792 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-41d26db9-26e8-4b86-af7a-13e3c980d340 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.269293 Jul 31 20:01:57.428500 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 153/303] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:57 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:01:57.430569 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-36a614b8-08cb-42ad-b45e-3e2a1cc1f8d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:57.432950 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:57.433653 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cc24053f-3dfe-4f57-af27-81f2be450622 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:57.434328 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cc24053f-3dfe-4f57-af27-81f2be450622 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:57.441096 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc24053f-3dfe-4f57-af27-81f2be450622 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:57.441580 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc24053f-3dfe-4f57-af27-81f2be450622 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:57.442357 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc24053f-3dfe-4f57-af27-81f2be450622 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:57.442776 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc24053f-3dfe-4f57-af27-81f2be450622 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:57.443695 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-36a614b8-08cb-42ad-b45e-3e2a1cc1f8d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.287935 Jul 31 20:01:57.444268 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 151/304] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:57 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:57.513541 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=12 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:57.581573 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cc24053f-3dfe-4f57-af27-81f2be450622 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:57.583858 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:57.590352 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cc24053f-3dfe-4f57-af27-81f2be450622 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1368 microversion: 2.1 time: 0.161069 Jul 31 20:01:57.590916 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 154/305] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:57 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:58.051437 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-19da7195-9ee1-4428-86c0-55989474cc57 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:58.052046 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-19da7195-9ee1-4428-86c0-55989474cc57 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:58.054233 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=8 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:58.059988 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19da7195-9ee1-4428-86c0-55989474cc57 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:58.060437 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19da7195-9ee1-4428-86c0-55989474cc57 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:58.061245 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19da7195-9ee1-4428-86c0-55989474cc57 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:58.061374 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e3d5d99e-f43f-4ad1-808f-755ad8cda88e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:58.061783 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19da7195-9ee1-4428-86c0-55989474cc57 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:58.061880 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3d5d99e-f43f-4ad1-808f-755ad8cda88e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:58.069338 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d5d99e-f43f-4ad1-808f-755ad8cda88e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:58.070092 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d5d99e-f43f-4ad1-808f-755ad8cda88e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:58.071179 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d5d99e-f43f-4ad1-808f-755ad8cda88e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:58.071654 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d5d99e-f43f-4ad1-808f-755ad8cda88e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:58.310856 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-19da7195-9ee1-4428-86c0-55989474cc57 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:58.316438 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3d5d99e-f43f-4ad1-808f-755ad8cda88e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:58.320286 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-19da7195-9ee1-4428-86c0-55989474cc57 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.272686 Jul 31 20:01:58.320848 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 152/306] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:58 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:58.325717 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3d5d99e-f43f-4ad1-808f-755ad8cda88e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:58.327393 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3d5d99e-f43f-4ad1-808f-755ad8cda88e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:58.328985 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e3d5d99e-f43f-4ad1-808f-755ad8cda88e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.272479 Jul 31 20:01:58.334807 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 155/307] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:01:58 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:01:58.449145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c87b6ff8-00ed-480f-af2a-027a651141a7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:58.449676 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c87b6ff8-00ed-480f-af2a-027a651141a7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:58.456281 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c87b6ff8-00ed-480f-af2a-027a651141a7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:58.456745 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c87b6ff8-00ed-480f-af2a-027a651141a7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:58.457551 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c87b6ff8-00ed-480f-af2a-027a651141a7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:58.457957 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c87b6ff8-00ed-480f-af2a-027a651141a7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:58.463833 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7963bb5b-f0ae-4c23-bcc9-632a7ec4732d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:58.464623 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7963bb5b-f0ae-4c23-bcc9-632a7ec4732d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:58.471107 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7963bb5b-f0ae-4c23-bcc9-632a7ec4732d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:58.471535 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7963bb5b-f0ae-4c23-bcc9-632a7ec4732d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:58.472316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7963bb5b-f0ae-4c23-bcc9-632a7ec4732d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:58.472919 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7963bb5b-f0ae-4c23-bcc9-632a7ec4732d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:58.724286 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c87b6ff8-00ed-480f-af2a-027a651141a7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:58.749316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7963bb5b-f0ae-4c23-bcc9-632a7ec4732d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:58.750358 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c87b6ff8-00ed-480f-af2a-027a651141a7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.305100 Jul 31 20:01:58.758738 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7963bb5b-f0ae-4c23-bcc9-632a7ec4732d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.298682 Jul 31 20:01:58.765662 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 153/308] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:58 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:58.766178 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 156/309] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:58 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:58.770620 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-76d2d725-a472-4aec-9c35-ea007b3b6f06 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:58.771231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-76d2d725-a472-4aec-9c35-ea007b3b6f06 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:58.782525 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76d2d725-a472-4aec-9c35-ea007b3b6f06 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:58.783094 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76d2d725-a472-4aec-9c35-ea007b3b6f06 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:58.783892 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76d2d725-a472-4aec-9c35-ea007b3b6f06 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:58.784333 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76d2d725-a472-4aec-9c35-ea007b3b6f06 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:59.341806 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eae568c3-5531-417a-a92e-5777bd034ede tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:59.342571 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eae568c3-5531-417a-a92e-5777bd034ede tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:59.344438 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:01:59.355827 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eae568c3-5531-417a-a92e-5777bd034ede tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:59.356261 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eae568c3-5531-417a-a92e-5777bd034ede tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:59.357173 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eae568c3-5531-417a-a92e-5777bd034ede tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:59.358139 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eae568c3-5531-417a-a92e-5777bd034ede tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:59.360116 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-76d2d725-a472-4aec-9c35-ea007b3b6f06 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:59.368852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-76d2d725-a472-4aec-9c35-ea007b3b6f06 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1368 microversion: 2.1 time: 0.601919 Jul 31 20:01:59.369961 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 154/310] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:58 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1368 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:01:59.388072 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e1f94da9-bdd6-4c40-9edb-368cdf94c6fc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:59.388691 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e1f94da9-bdd6-4c40-9edb-368cdf94c6fc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:59.394915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1f94da9-bdd6-4c40-9edb-368cdf94c6fc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:59.395352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1f94da9-bdd6-4c40-9edb-368cdf94c6fc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:59.396291 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1f94da9-bdd6-4c40-9edb-368cdf94c6fc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:59.396865 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1f94da9-bdd6-4c40-9edb-368cdf94c6fc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:59.655335 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e1f94da9-bdd6-4c40-9edb-368cdf94c6fc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:59.660575 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eae568c3-5531-417a-a92e-5777bd034ede tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:59.663796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e1f94da9-bdd6-4c40-9edb-368cdf94c6fc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:59.665600 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e1f94da9-bdd6-4c40-9edb-368cdf94c6fc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:01:59.666815 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e1f94da9-bdd6-4c40-9edb-368cdf94c6fc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.284023 Jul 31 20:01:59.667590 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 155/311] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:01:59 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:01:59.669004 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eae568c3-5531-417a-a92e-5777bd034ede tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.331079 Jul 31 20:01:59.669758 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 157/312] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:59 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:01:59.771939 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bd3ffa21-4d2b-4366-9098-555a62502668 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:59.772644 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bd3ffa21-4d2b-4366-9098-555a62502668 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:59.778989 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-79379d4d-1c1f-4f02-9384-cc60ba003d26 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:01:59.779562 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-79379d4d-1c1f-4f02-9384-cc60ba003d26 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:01:59.779692 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bd3ffa21-4d2b-4366-9098-555a62502668 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:59.780099 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bd3ffa21-4d2b-4366-9098-555a62502668 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:59.780873 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bd3ffa21-4d2b-4366-9098-555a62502668 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:59.781333 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bd3ffa21-4d2b-4366-9098-555a62502668 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:59.785987 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79379d4d-1c1f-4f02-9384-cc60ba003d26 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:59.786675 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79379d4d-1c1f-4f02-9384-cc60ba003d26 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:59.787398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79379d4d-1c1f-4f02-9384-cc60ba003d26 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:01:59.788005 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79379d4d-1c1f-4f02-9384-cc60ba003d26 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:01:59.992637 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bd3ffa21-4d2b-4366-9098-555a62502668 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:00.001067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-79379d4d-1c1f-4f02-9384-cc60ba003d26 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:00.005252 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bd3ffa21-4d2b-4366-9098-555a62502668 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1501 microversion: 2.1 time: 0.237040 Jul 31 20:02:00.017617 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 156/313] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:59 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1501 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:00.017779 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-79379d4d-1c1f-4f02-9384-cc60ba003d26 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.235947 Jul 31 20:02:00.017779 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 158/314] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:01:59 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:00.028297 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3045d497-a345-4a1b-829a-cfb907fc4db8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3034245-8541-44a0-b9c3-51456e3f9a3a"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:00.030781 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3045d497-a345-4a1b-829a-cfb907fc4db8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:00.038341 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3045d497-a345-4a1b-829a-cfb907fc4db8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:00.045554 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3045d497-a345-4a1b-829a-cfb907fc4db8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:00.046639 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3045d497-a345-4a1b-829a-cfb907fc4db8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:00.047126 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3045d497-a345-4a1b-829a-cfb907fc4db8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:00.065357 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:00.072879 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-3045d497-a345-4a1b-829a-cfb907fc4db8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] HTTP exception thrown: Cannot 'attach_volume' instance a098dc51-df70-4d1b-ae0b-264fdb83e932 while it is in vm_state rescued Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3045d497-a345-4a1b-829a-cfb907fc4db8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Request method failure captured: Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: POST /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932/os-volume_attachments HTTP/1.1 Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 74 Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8wkAlbXsas087082cheCywlugC2lHFFc9iVqgo6_sBsR-YY5pZu5t-1nBKYhilL82c6N8gE1zCXnBGzizSkvsRiCQKIGfA7AeTxya_nSNWYEfiyYJL4ENUjFdbfKAqnXJ6B5iGF_OvnduRT1jdq2eFQLBjV9thklPR9a7cgSgtG9I Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 41f4d4561f4f40f8b370b8cc943c97af Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:02:00.074616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:02:00.076162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/41f4d4561f4f40f8b370b8cc943c97af"}]}] Jul 31 20:02:00.076162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:02:00.076162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 41f4d4561f4f40f8b370b8cc943c97af Jul 31 20:02:00.076162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:02:00.076162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-ServerRescueNegativeTestJSON-154903434-project Jul 31 20:02:00.076162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:02:00.076162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:02:00.076162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 89abc5820b584315a8413f6402f7ff1f Jul 31 20:02:00.076162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-154903434-project Jul 31 20:02:00.076162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Jul 31 20:02:00.076162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {"volumeAttachment": {"volumeId": "d3034245-8541-44a0-b9c3-51456e3f9a3a"}} Jul 31 20:02:00.076162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Cannot 'attach_volume' instance a098dc51-df70-4d1b-ae0b-264fdb83e932 while it is in vm_state rescued Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'server_id': 'a098dc51-df70-4d1b-ae0b-264fdb83e932', 'body': {'volumeAttachment': {'volumeId': 'd3034245-8541-44a0-b9c3-51456e3f9a3a'}}} Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a098dc51-df70-4d1b-ae0b-264fdb83e932 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:02:00.077001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a098dc51-df70-4d1b-ae0b-264fdb83e932 while it is in vm_state rescued Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:02:00.078165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:02:00.079257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:02:00.079257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:02:00.079257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a098dc51-df70-4d1b-ae0b-264fdb83e932 while it is in vm_state rescued Jul 31 20:02:00.079257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:02:00.079257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3045d497-a345-4a1b-829a-cfb907fc4db8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Returning 409 to user: Cannot 'attach_volume' instance a098dc51-df70-4d1b-ae0b-264fdb83e932 while it is in vm_state rescued {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:02:00.079257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3045d497-a345-4a1b-829a-cfb907fc4db8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "POST /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053224 Jul 31 20:02:00.079257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 157/315] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:02:00 2022] POST /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 20:02:00.085847 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b2162631-24c2-4080-9d24-e2dfe043a591 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:00.086376 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b2162631-24c2-4080-9d24-e2dfe043a591 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:00.092458 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2162631-24c2-4080-9d24-e2dfe043a591 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:00.094106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2162631-24c2-4080-9d24-e2dfe043a591 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:00.094901 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2162631-24c2-4080-9d24-e2dfe043a591 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:00.095464 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2162631-24c2-4080-9d24-e2dfe043a591 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:00.174806 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b2162631-24c2-4080-9d24-e2dfe043a591 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "POST /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932/action" status: 202 len: 0 microversion: 2.1 time: 0.093078 Jul 31 20:02:00.175430 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 159/316] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:02:00 2022] POST /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:02:00.184812 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e8793626-2135-4eca-b044-22bc4890e702 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:00.185524 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e8793626-2135-4eca-b044-22bc4890e702 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:00.192104 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8793626-2135-4eca-b044-22bc4890e702 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:00.192580 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8793626-2135-4eca-b044-22bc4890e702 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:00.193815 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8793626-2135-4eca-b044-22bc4890e702 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:00.194307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8793626-2135-4eca-b044-22bc4890e702 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:00.396505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fd82b3d4-b37d-45dd-9b5e-1081b143e283 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:00.398028 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fd82b3d4-b37d-45dd-9b5e-1081b143e283 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:00.405529 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd82b3d4-b37d-45dd-9b5e-1081b143e283 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:00.406154 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd82b3d4-b37d-45dd-9b5e-1081b143e283 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:00.407229 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e8793626-2135-4eca-b044-22bc4890e702 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:00.407883 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd82b3d4-b37d-45dd-9b5e-1081b143e283 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:00.408469 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd82b3d4-b37d-45dd-9b5e-1081b143e283 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:00.421087 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e8793626-2135-4eca-b044-22bc4890e702 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1509 microversion: 2.1 time: 0.240593 Jul 31 20:02:00.422214 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 158/317] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:00 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:00.632033 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fd82b3d4-b37d-45dd-9b5e-1081b143e283 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:00.640038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fd82b3d4-b37d-45dd-9b5e-1081b143e283 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1368 microversion: 2.1 time: 0.249269 Jul 31 20:02:00.640750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 160/318] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:00 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:00.691503 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a7333c4f-23c5-43cc-b4fa-32ba54c09b5e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:00.691884 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ea143deb-033a-4251-a3de-03de7606e4b7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:00.692491 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ea143deb-033a-4251-a3de-03de7606e4b7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:00.692638 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a7333c4f-23c5-43cc-b4fa-32ba54c09b5e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:00.699553 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7333c4f-23c5-43cc-b4fa-32ba54c09b5e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:00.700082 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7333c4f-23c5-43cc-b4fa-32ba54c09b5e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:00.700938 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7333c4f-23c5-43cc-b4fa-32ba54c09b5e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:00.701475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7333c4f-23c5-43cc-b4fa-32ba54c09b5e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:00.702073 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea143deb-033a-4251-a3de-03de7606e4b7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:00.702517 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea143deb-033a-4251-a3de-03de7606e4b7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:00.703302 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea143deb-033a-4251-a3de-03de7606e4b7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:00.703726 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea143deb-033a-4251-a3de-03de7606e4b7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:01.000540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a7333c4f-23c5-43cc-b4fa-32ba54c09b5e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:01.010405 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ea143deb-033a-4251-a3de-03de7606e4b7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:01.017965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a7333c4f-23c5-43cc-b4fa-32ba54c09b5e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.329709 Jul 31 20:02:01.018831 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 159/319] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:00 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:01.023433 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ea143deb-033a-4251-a3de-03de7606e4b7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:01.024514 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-01b0e359-a955-4dc4-a545-589cbb8f5ce1 req-9f3c0533-f45c-43b8-96ce-2eaa412b7198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feed8b88-8df9-44a5-9520-0d723924fd1d", "name": "network-vif-plugged", "status": "completed", "tag": "d1dea7a4-f82d-4a04-9a13-0e5ac255e8b3"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:01.029202 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ea143deb-033a-4251-a3de-03de7606e4b7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:01.031018 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ea143deb-033a-4251-a3de-03de7606e4b7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.342941 Jul 31 20:02:01.032394 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 161/320] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:00 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:01.040376 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4fdd23bb-2d56-4233-8276-01adc8e667d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:01.041966 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4fdd23bb-2d56-4233-8276-01adc8e667d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:01.042327 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-01b0e359-a955-4dc4-a545-589cbb8f5ce1 req-9f3c0533-f45c-43b8-96ce-2eaa412b7198 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:01.042760 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-01b0e359-a955-4dc4-a545-589cbb8f5ce1 req-9f3c0533-f45c-43b8-96ce-2eaa412b7198 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:01.051098 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fdd23bb-2d56-4233-8276-01adc8e667d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:01.051885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fdd23bb-2d56-4233-8276-01adc8e667d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:01.052979 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fdd23bb-2d56-4233-8276-01adc8e667d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:01.053657 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fdd23bb-2d56-4233-8276-01adc8e667d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:01.057514 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-01b0e359-a955-4dc4-a545-589cbb8f5ce1 req-9f3c0533-f45c-43b8-96ce-2eaa412b7198 service nova] Creating event network-vif-plugged:d1dea7a4-f82d-4a04-9a13-0e5ac255e8b3 for instance feed8b88-8df9-44a5-9520-0d723924fd1d on hv-cinder-84984 Jul 31 20:02:01.063933 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-01b0e359-a955-4dc4-a545-589cbb8f5ce1 req-9f3c0533-f45c-43b8-96ce-2eaa412b7198 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043060 Jul 31 20:02:01.064695 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 160/321] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:02:01.202858 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4fdd23bb-2d56-4233-8276-01adc8e667d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:01.211057 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4fdd23bb-2d56-4233-8276-01adc8e667d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.177231 Jul 31 20:02:01.211681 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 162/322] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:01 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:01.443109 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-dadfc389-9009-4849-958a-bbc31cd95335 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:01.443843 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-dadfc389-9009-4849-958a-bbc31cd95335 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:01.450994 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dadfc389-9009-4849-958a-bbc31cd95335 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:01.451431 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dadfc389-9009-4849-958a-bbc31cd95335 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:01.452571 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dadfc389-9009-4849-958a-bbc31cd95335 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:01.453007 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dadfc389-9009-4849-958a-bbc31cd95335 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:01.585904 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dadfc389-9009-4849-958a-bbc31cd95335 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:01.593612 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-dadfc389-9009-4849-958a-bbc31cd95335 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1509 microversion: 2.1 time: 0.154803 Jul 31 20:02:01.594201 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 161/323] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:01 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:01.660870 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8fb9c688-ac59-45db-a99d-de797f6cce4e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:01.661464 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8fb9c688-ac59-45db-a99d-de797f6cce4e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:01.668019 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8fb9c688-ac59-45db-a99d-de797f6cce4e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:01.668461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8fb9c688-ac59-45db-a99d-de797f6cce4e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:01.669309 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8fb9c688-ac59-45db-a99d-de797f6cce4e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:01.669682 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8fb9c688-ac59-45db-a99d-de797f6cce4e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:01.804153 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8fb9c688-ac59-45db-a99d-de797f6cce4e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:01.811738 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8fb9c688-ac59-45db-a99d-de797f6cce4e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1368 microversion: 2.1 time: 0.154753 Jul 31 20:02:01.812275 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 163/324] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:01 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:02.057167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6ad2f875-7a08-4e68-ad4b-b542fff8b80c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:02.057889 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6ad2f875-7a08-4e68-ad4b-b542fff8b80c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:02.065995 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ad2f875-7a08-4e68-ad4b-b542fff8b80c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:02.066521 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ad2f875-7a08-4e68-ad4b-b542fff8b80c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:02.067278 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9570a243-9da3-46d4-b084-982b9bd44667 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:02.067441 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ad2f875-7a08-4e68-ad4b-b542fff8b80c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:02.068037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9570a243-9da3-46d4-b084-982b9bd44667 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:02.068661 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ad2f875-7a08-4e68-ad4b-b542fff8b80c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:02.075774 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9570a243-9da3-46d4-b084-982b9bd44667 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:02.076330 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9570a243-9da3-46d4-b084-982b9bd44667 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:02.077142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9570a243-9da3-46d4-b084-982b9bd44667 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:02.077761 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9570a243-9da3-46d4-b084-982b9bd44667 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:02.273991 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6ad2f875-7a08-4e68-ad4b-b542fff8b80c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:02.278470 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9570a243-9da3-46d4-b084-982b9bd44667 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:02.282735 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6ad2f875-7a08-4e68-ad4b-b542fff8b80c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.229594 Jul 31 20:02:02.286997 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9570a243-9da3-46d4-b084-982b9bd44667 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:02.288531 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9570a243-9da3-46d4-b084-982b9bd44667 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:02.289701 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9570a243-9da3-46d4-b084-982b9bd44667 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.226489 Jul 31 20:02:02.290269 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 164/325] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:02 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:02.304161 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b0bda5ba-2ad5-4500-a687-c5649eca16f6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:02.304161 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b0bda5ba-2ad5-4500-a687-c5649eca16f6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:02.304375 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 162/326] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:02 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:02.304475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0bda5ba-2ad5-4500-a687-c5649eca16f6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:02.304475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0bda5ba-2ad5-4500-a687-c5649eca16f6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:02.304475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0bda5ba-2ad5-4500-a687-c5649eca16f6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:02.304475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0bda5ba-2ad5-4500-a687-c5649eca16f6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:02.434843 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b0bda5ba-2ad5-4500-a687-c5649eca16f6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:02.443027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b0bda5ba-2ad5-4500-a687-c5649eca16f6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.151795 Jul 31 20:02:02.443633 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 165/327] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:02 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:02.617130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f970a675-6a74-4936-9776-393f27faaf3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:02.617752 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f970a675-6a74-4936-9776-393f27faaf3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:02.625186 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f970a675-6a74-4936-9776-393f27faaf3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:02.625635 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f970a675-6a74-4936-9776-393f27faaf3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:02.626389 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f970a675-6a74-4936-9776-393f27faaf3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:02.626821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f970a675-6a74-4936-9776-393f27faaf3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:02.764675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f970a675-6a74-4936-9776-393f27faaf3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:02.772388 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f970a675-6a74-4936-9776-393f27faaf3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1509 microversion: 2.1 time: 0.160861 Jul 31 20:02:02.773351 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 163/328] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:02 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:02.832673 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fe5af7c4-c85f-479e-8239-108b24a95cf9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:02.833265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fe5af7c4-c85f-479e-8239-108b24a95cf9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:02.840130 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe5af7c4-c85f-479e-8239-108b24a95cf9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:02.840494 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe5af7c4-c85f-479e-8239-108b24a95cf9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:02.841382 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe5af7c4-c85f-479e-8239-108b24a95cf9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:02.841845 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe5af7c4-c85f-479e-8239-108b24a95cf9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:02.979072 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe5af7c4-c85f-479e-8239-108b24a95cf9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:02.986733 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fe5af7c4-c85f-479e-8239-108b24a95cf9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1368 microversion: 2.1 time: 0.157964 Jul 31 20:02:02.987365 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 166/329] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:02 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:03.308048 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-971c07eb-b02a-42e2-9820-949b5ae9f8e6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:03.308759 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-971c07eb-b02a-42e2-9820-949b5ae9f8e6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:03.313892 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bd880e68-bc72-45a1-8950-430a07440d1f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:03.314640 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bd880e68-bc72-45a1-8950-430a07440d1f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:03.316343 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-971c07eb-b02a-42e2-9820-949b5ae9f8e6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:03.316881 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-971c07eb-b02a-42e2-9820-949b5ae9f8e6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:03.317826 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-971c07eb-b02a-42e2-9820-949b5ae9f8e6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:03.318337 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-971c07eb-b02a-42e2-9820-949b5ae9f8e6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:03.321961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd880e68-bc72-45a1-8950-430a07440d1f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:03.322485 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd880e68-bc72-45a1-8950-430a07440d1f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:03.323367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd880e68-bc72-45a1-8950-430a07440d1f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:03.323871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd880e68-bc72-45a1-8950-430a07440d1f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:03.526606 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd880e68-bc72-45a1-8950-430a07440d1f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:03.529135 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-971c07eb-b02a-42e2-9820-949b5ae9f8e6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:03.534864 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd880e68-bc72-45a1-8950-430a07440d1f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:03.536357 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd880e68-bc72-45a1-8950-430a07440d1f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:03.537451 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-971c07eb-b02a-42e2-9820-949b5ae9f8e6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.234560 Jul 31 20:02:03.537603 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bd880e68-bc72-45a1-8950-430a07440d1f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.228448 Jul 31 20:02:03.538018 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 164/330] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:03 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:03.539195 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 167/331] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:03 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:03.542449 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-af664ede-204d-4314-a9d4-8ec852588f20 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:03.543035 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-af664ede-204d-4314-a9d4-8ec852588f20 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:03.548984 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af664ede-204d-4314-a9d4-8ec852588f20 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:03.549459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af664ede-204d-4314-a9d4-8ec852588f20 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:03.550200 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af664ede-204d-4314-a9d4-8ec852588f20 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:03.550623 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af664ede-204d-4314-a9d4-8ec852588f20 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:03.703670 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-af664ede-204d-4314-a9d4-8ec852588f20 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:03.715006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-af664ede-204d-4314-a9d4-8ec852588f20 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.175863 Jul 31 20:02:03.728845 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 165/332] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:03 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:03.794848 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-14438e80-7e20-4609-8406-9ae287fd97d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:03.795581 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-14438e80-7e20-4609-8406-9ae287fd97d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:03.802211 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14438e80-7e20-4609-8406-9ae287fd97d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:03.802690 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14438e80-7e20-4609-8406-9ae287fd97d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:03.803685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14438e80-7e20-4609-8406-9ae287fd97d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:03.804169 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14438e80-7e20-4609-8406-9ae287fd97d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:03.936541 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-14438e80-7e20-4609-8406-9ae287fd97d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:03.945994 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-14438e80-7e20-4609-8406-9ae287fd97d1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1515 microversion: 2.1 time: 0.155738 Jul 31 20:02:03.946598 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 168/333] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:03 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:04.008633 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cc31739c-5221-4571-8770-11fda1c98966 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:04.009274 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cc31739c-5221-4571-8770-11fda1c98966 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:04.015447 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc31739c-5221-4571-8770-11fda1c98966 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:04.015884 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc31739c-5221-4571-8770-11fda1c98966 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:04.016637 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc31739c-5221-4571-8770-11fda1c98966 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:04.017165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc31739c-5221-4571-8770-11fda1c98966 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:04.213407 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cc31739c-5221-4571-8770-11fda1c98966 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:04.221005 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cc31739c-5221-4571-8770-11fda1c98966 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1368 microversion: 2.1 time: 0.216813 Jul 31 20:02:04.233638 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 166/334] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:04 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:04.558116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-07fcfe85-6af2-4b81-a347-e25ff41a5eee tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:04.558723 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-07fcfe85-6af2-4b81-a347-e25ff41a5eee tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:04.565556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07fcfe85-6af2-4b81-a347-e25ff41a5eee tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:04.565556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07fcfe85-6af2-4b81-a347-e25ff41a5eee tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:04.569219 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07fcfe85-6af2-4b81-a347-e25ff41a5eee tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:04.573064 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6989757c-00c2-4e13-87d9-86e164f34684 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:04.574048 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6989757c-00c2-4e13-87d9-86e164f34684 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:04.574175 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07fcfe85-6af2-4b81-a347-e25ff41a5eee tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:04.582341 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6989757c-00c2-4e13-87d9-86e164f34684 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:04.583005 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6989757c-00c2-4e13-87d9-86e164f34684 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:04.584032 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6989757c-00c2-4e13-87d9-86e164f34684 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:04.584613 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6989757c-00c2-4e13-87d9-86e164f34684 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:04.802248 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-07fcfe85-6af2-4b81-a347-e25ff41a5eee tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:04.803281 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6989757c-00c2-4e13-87d9-86e164f34684 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:04.811503 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6989757c-00c2-4e13-87d9-86e164f34684 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:04.812077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-07fcfe85-6af2-4b81-a347-e25ff41a5eee tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.257832 Jul 31 20:02:04.812671 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 169/335] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:04 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:04.812956 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6989757c-00c2-4e13-87d9-86e164f34684 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:04.814122 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6989757c-00c2-4e13-87d9-86e164f34684 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1744 microversion: 2.20 time: 0.257568 Jul 31 20:02:04.814796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 167/336] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:04 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1744 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:02:04.818256 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf85e454-4e22-400c-aa0b-a85dbec682ee tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:04.819043 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cf85e454-4e22-400c-aa0b-a85dbec682ee tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:04.829010 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf85e454-4e22-400c-aa0b-a85dbec682ee tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:04.831690 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf85e454-4e22-400c-aa0b-a85dbec682ee tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:04.834684 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf85e454-4e22-400c-aa0b-a85dbec682ee tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:04.835119 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf85e454-4e22-400c-aa0b-a85dbec682ee tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:04.857182 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:04.985956 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cf85e454-4e22-400c-aa0b-a85dbec682ee tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:04.993836 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf85e454-4e22-400c-aa0b-a85dbec682ee tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.180167 Jul 31 20:02:04.994755 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 170/337] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:04 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:05.246817 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-89968966-7c19-483d-b3cb-cfb6f5d9f1cd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:05.247714 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-89968966-7c19-483d-b3cb-cfb6f5d9f1cd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:05.257033 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89968966-7c19-483d-b3cb-cfb6f5d9f1cd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:05.257503 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89968966-7c19-483d-b3cb-cfb6f5d9f1cd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:05.258249 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89968966-7c19-483d-b3cb-cfb6f5d9f1cd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:05.258672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89968966-7c19-483d-b3cb-cfb6f5d9f1cd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:05.361119 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-239b463d-f341-4983-b7dc-3c03c1bceb34 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Action: 'create', calling method: .version_select at 0x7ffa249c71f0>, body: {"keypair": {"name": "tempest-keypair-2139810082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1nM5mEpuW0AjA/765jVs37zyc1QslUycfsx3atJxdkhZcy1Rm8jtnjtwhMHflHAWucvfDpe4C2pLAbzP/9S4q6SLYnZVhH8Ik38MtziSKmAw9yjw/+YCHFkJIw+vW3Og=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:05.377770 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-239b463d-f341-4983-b7dc-3c03c1bceb34 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Getting quotas for project 41f4d4561f4f40f8b370b8cc943c97af. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:02:05.381893 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-239b463d-f341-4983-b7dc-3c03c1bceb34 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Getting quotas for user 89abc5820b584315a8413f6402f7ff1f and project 41f4d4561f4f40f8b370b8cc943c97af. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:02:05.397835 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-89968966-7c19-483d-b3cb-cfb6f5d9f1cd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:05.407197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-89968966-7c19-483d-b3cb-cfb6f5d9f1cd tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1368 microversion: 2.1 time: 0.167142 Jul 31 20:02:05.408443 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-239b463d-f341-4983-b7dc-3c03c1bceb34 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051059 Jul 31 20:02:05.408674 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 168/338] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:05 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:05.413667 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 171/339] 10.222.0.48 () {60 vars in 1159 bytes} [Sun Jul 31 20:02:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:02:05.845394 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4350a870-d245-4db8-9e78-e6b54a435249 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:05.847597 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8cab9e43-6aef-479e-90f4-f85e0883caf5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:05.848788 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8cab9e43-6aef-479e-90f4-f85e0883caf5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:05.850871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4350a870-d245-4db8-9e78-e6b54a435249 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:05.859984 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4350a870-d245-4db8-9e78-e6b54a435249 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:05.860768 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4350a870-d245-4db8-9e78-e6b54a435249 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:05.861585 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4350a870-d245-4db8-9e78-e6b54a435249 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:05.862047 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4350a870-d245-4db8-9e78-e6b54a435249 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:05.863403 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8cab9e43-6aef-479e-90f4-f85e0883caf5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:05.863997 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8cab9e43-6aef-479e-90f4-f85e0883caf5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:05.865042 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8cab9e43-6aef-479e-90f4-f85e0883caf5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:05.865810 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8cab9e43-6aef-479e-90f4-f85e0883caf5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:06.192024 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4350a870-d245-4db8-9e78-e6b54a435249 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:06.200886 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4350a870-d245-4db8-9e78-e6b54a435249 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:06.202947 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4350a870-d245-4db8-9e78-e6b54a435249 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:06.204451 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4350a870-d245-4db8-9e78-e6b54a435249 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1744 microversion: 2.20 time: 0.369262 Jul 31 20:02:06.205274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 172/340] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:05 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1744 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:06.210015 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d76a9807-c474-4a6a-9ac3-11a0d3c32c40 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:06.210981 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d76a9807-c474-4a6a-9ac3-11a0d3c32c40 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:06.217582 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d76a9807-c474-4a6a-9ac3-11a0d3c32c40 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:06.218394 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d76a9807-c474-4a6a-9ac3-11a0d3c32c40 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:06.218520 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8cab9e43-6aef-479e-90f4-f85e0883caf5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:06.219546 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d76a9807-c474-4a6a-9ac3-11a0d3c32c40 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:06.220185 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d76a9807-c474-4a6a-9ac3-11a0d3c32c40 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:06.228592 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8cab9e43-6aef-479e-90f4-f85e0883caf5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.397268 Jul 31 20:02:06.229202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 169/341] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:05 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:06.430434 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e6c0bccb-b107-4dcd-a19b-64840441fd08 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:06.431166 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e6c0bccb-b107-4dcd-a19b-64840441fd08 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:06.437882 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6c0bccb-b107-4dcd-a19b-64840441fd08 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:06.439010 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6c0bccb-b107-4dcd-a19b-64840441fd08 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:06.441397 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6c0bccb-b107-4dcd-a19b-64840441fd08 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:06.441397 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6c0bccb-b107-4dcd-a19b-64840441fd08 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:06.470114 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d76a9807-c474-4a6a-9ac3-11a0d3c32c40 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:06.482152 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d76a9807-c474-4a6a-9ac3-11a0d3c32c40 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.275526 Jul 31 20:02:06.482885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 173/342] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:06 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:06.643173 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e6c0bccb-b107-4dcd-a19b-64840441fd08 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:06.651558 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e6c0bccb-b107-4dcd-a19b-64840441fd08 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1368 microversion: 2.1 time: 0.227438 Jul 31 20:02:06.660495 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 170/343] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:06 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:07.134034 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1407813535", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53f36ad7-07fc-4450-bca6-30cfbe8fbc79"}], "security_groups": [{"name": "tempest-securitygroup--2056822008"}], "key_name": "tempest-keypair-2139810082", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:07.229260 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c21563d6-c717-46de-82a5-86c486a84ac7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:07.229867 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c21563d6-c717-46de-82a5-86c486a84ac7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:07.237993 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c21563d6-c717-46de-82a5-86c486a84ac7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:07.238489 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c21563d6-c717-46de-82a5-86c486a84ac7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:07.239366 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c21563d6-c717-46de-82a5-86c486a84ac7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:07.239967 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c21563d6-c717-46de-82a5-86c486a84ac7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:07.256164 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] validate_networks() for [('53f36ad7-07fc-4450-bca6-30cfbe8fbc79', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:02:07.733225 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c21563d6-c717-46de-82a5-86c486a84ac7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:07.742149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c21563d6-c717-46de-82a5-86c486a84ac7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:07.743926 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c21563d6-c717-46de-82a5-86c486a84ac7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:07.745499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c21563d6-c717-46de-82a5-86c486a84ac7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1744 microversion: 2.20 time: 0.521616 Jul 31 20:02:07.746403 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 171/344] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:07 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1744 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:07.751137 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e81456df-8dc1-4e85-8ee8-50fe29a0b60d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:07.751716 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e81456df-8dc1-4e85-8ee8-50fe29a0b60d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:07.758708 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e81456df-8dc1-4e85-8ee8-50fe29a0b60d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:07.759260 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e81456df-8dc1-4e85-8ee8-50fe29a0b60d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:07.759889 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e81456df-8dc1-4e85-8ee8-50fe29a0b60d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:07.760494 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e81456df-8dc1-4e85-8ee8-50fe29a0b60d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:07.986725 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e81456df-8dc1-4e85-8ee8-50fe29a0b60d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:07.995422 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e81456df-8dc1-4e85-8ee8-50fe29a0b60d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.247578 Jul 31 20:02:07.996405 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 172/345] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:07 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:08.001105 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c719735a-8b58-4431-9964-442f9c0c16d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:08.001728 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c719735a-8b58-4431-9964-442f9c0c16d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:08.007592 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c719735a-8b58-4431-9964-442f9c0c16d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:08.008063 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c719735a-8b58-4431-9964-442f9c0c16d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:08.008812 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c719735a-8b58-4431-9964-442f9c0c16d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:08.009258 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c719735a-8b58-4431-9964-442f9c0c16d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:08.151208 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:02:08.154225 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:02:08.154798 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:02:08.155350 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:02:08.155820 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:02:08.171595 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:08.172309 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:08.173133 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c719735a-8b58-4431-9964-442f9c0c16d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:08.173301 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:08.173756 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:08.186783 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c719735a-8b58-4431-9964-442f9c0c16d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.189188 Jul 31 20:02:08.188010 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 173/346] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:07 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:08.194142 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-aa73ed86-ab3e-4f8a-bd92-ef17fc38fe05 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:08.194285 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Getting quotas for project 41f4d4561f4f40f8b370b8cc943c97af. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:02:08.195018 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-aa73ed86-ab3e-4f8a-bd92-ef17fc38fe05 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:08.198557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Getting quotas for user 89abc5820b584315a8413f6402f7ff1f and project 41f4d4561f4f40f8b370b8cc943c97af. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:02:08.202703 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa73ed86-ab3e-4f8a-bd92-ef17fc38fe05 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:08.203340 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa73ed86-ab3e-4f8a-bd92-ef17fc38fe05 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:08.204265 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa73ed86-ab3e-4f8a-bd92-ef17fc38fe05 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:08.205670 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa73ed86-ab3e-4f8a-bd92-ef17fc38fe05 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:08.210698 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:02:08.213686 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:02:08.276398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e3e3020c-b8c0-41bd-aa7b-212b852be6a9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.147021 Jul 31 20:02:08.285296 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 174/347] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:02:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:02:08.290891 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6420e807-e067-4e29-88d9-07f11849b722 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:08.291714 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6420e807-e067-4e29-88d9-07f11849b722 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:08.360157 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6420e807-e067-4e29-88d9-07f11849b722 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:08.367253 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6420e807-e067-4e29-88d9-07f11849b722 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1246 microversion: 2.1 time: 0.080646 Jul 31 20:02:08.367803 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 175/348] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:08 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:08.395933 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-aa73ed86-ab3e-4f8a-bd92-ef17fc38fe05 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:08.403673 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-aa73ed86-ab3e-4f8a-bd92-ef17fc38fe05 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1559 microversion: 2.1 time: 0.214081 Jul 31 20:02:08.404243 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 174/349] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:08 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:08.424316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7418fb2c-f378-4e5a-8eff-c5a785772907 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:08.424316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7418fb2c-f378-4e5a-8eff-c5a785772907 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:08.431384 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7418fb2c-f378-4e5a-8eff-c5a785772907 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:08.432080 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7418fb2c-f378-4e5a-8eff-c5a785772907 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:08.432870 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7418fb2c-f378-4e5a-8eff-c5a785772907 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:08.433362 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7418fb2c-f378-4e5a-8eff-c5a785772907 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:08.519627 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7418fb2c-f378-4e5a-8eff-c5a785772907 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099584 Jul 31 20:02:08.520228 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 176/350] 10.222.0.48 () {58 vars in 1275 bytes} [Sun Jul 31 20:02:08 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:02:08.770053 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-438a554f-5b33-437a-b7cc-7b707d6a8c16 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:08.770731 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-438a554f-5b33-437a-b7cc-7b707d6a8c16 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:08.777599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-438a554f-5b33-437a-b7cc-7b707d6a8c16 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:08.778111 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-438a554f-5b33-437a-b7cc-7b707d6a8c16 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:08.778931 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-438a554f-5b33-437a-b7cc-7b707d6a8c16 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:08.779580 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-438a554f-5b33-437a-b7cc-7b707d6a8c16 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:08.785458 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:08.960698 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-438a554f-5b33-437a-b7cc-7b707d6a8c16 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:08.975212 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-438a554f-5b33-437a-b7cc-7b707d6a8c16 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:08.976815 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-438a554f-5b33-437a-b7cc-7b707d6a8c16 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:08.978055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-438a554f-5b33-437a-b7cc-7b707d6a8c16 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1739 microversion: 2.20 time: 0.213125 Jul 31 20:02:08.979332 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 175/351] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:08 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:09.018473 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d456fa63-ef0f-45a1-b94c-1d16dd6ff7f7 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:09.019858 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d456fa63-ef0f-45a1-b94c-1d16dd6ff7f7 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:09.028452 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d456fa63-ef0f-45a1-b94c-1d16dd6ff7f7 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:09.029133 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d456fa63-ef0f-45a1-b94c-1d16dd6ff7f7 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:09.030206 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d456fa63-ef0f-45a1-b94c-1d16dd6ff7f7 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:09.030825 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d456fa63-ef0f-45a1-b94c-1d16dd6ff7f7 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:09.216047 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d456fa63-ef0f-45a1-b94c-1d16dd6ff7f7 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:09.224169 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e11685d5-f260-4c44-8221-4f58f10ffc6a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:09.227364 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e11685d5-f260-4c44-8221-4f58f10ffc6a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:09.247885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d456fa63-ef0f-45a1-b94c-1d16dd6ff7f7 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.234064 Jul 31 20:02:09.256212 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e11685d5-f260-4c44-8221-4f58f10ffc6a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:09.258312 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 177/352] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:09 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:09.258722 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e11685d5-f260-4c44-8221-4f58f10ffc6a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:09.260084 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e11685d5-f260-4c44-8221-4f58f10ffc6a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:09.260980 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e11685d5-f260-4c44-8221-4f58f10ffc6a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:09.388404 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e3fc733a-6d59-4665-a53f-6d93fa9a378f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:09.389028 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3fc733a-6d59-4665-a53f-6d93fa9a378f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:09.397396 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3fc733a-6d59-4665-a53f-6d93fa9a378f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:09.400093 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3fc733a-6d59-4665-a53f-6d93fa9a378f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:09.401099 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3fc733a-6d59-4665-a53f-6d93fa9a378f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:09.404286 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3fc733a-6d59-4665-a53f-6d93fa9a378f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:09.456200 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e11685d5-f260-4c44-8221-4f58f10ffc6a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:09.466022 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e11685d5-f260-4c44-8221-4f58f10ffc6a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.257614 Jul 31 20:02:09.477247 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 176/353] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:09 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:09.487535 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-022afef4-9c45-45ab-9818-02b08ec4b2bd req-1c0e5efd-42cd-48bd-bdbe-2a3c2493f8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb0b91c-9a78-49a1-a96b-016c09759655", "name": "network-vif-plugged", "status": "completed", "tag": "eaea7f4e-af98-4acb-9edb-366b7b6e28d8"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:09.499989 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-022afef4-9c45-45ab-9818-02b08ec4b2bd req-1c0e5efd-42cd-48bd-bdbe-2a3c2493f8be service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:09.500434 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-022afef4-9c45-45ab-9818-02b08ec4b2bd req-1c0e5efd-42cd-48bd-bdbe-2a3c2493f8be service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:09.542669 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-022afef4-9c45-45ab-9818-02b08ec4b2bd req-1c0e5efd-42cd-48bd-bdbe-2a3c2493f8be service nova] Creating event network-vif-plugged:eaea7f4e-af98-4acb-9edb-366b7b6e28d8 for instance cdb0b91c-9a78-49a1-a96b-016c09759655 on hv-cinder-84984 Jul 31 20:02:09.553384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-022afef4-9c45-45ab-9818-02b08ec4b2bd req-1c0e5efd-42cd-48bd-bdbe-2a3c2493f8be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082512 Jul 31 20:02:09.554445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 177/354] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:02:09.584207 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3fc733a-6d59-4665-a53f-6d93fa9a378f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:09.592994 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e3fc733a-6d59-4665-a53f-6d93fa9a378f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1298 microversion: 2.1 time: 0.208562 Jul 31 20:02:09.595794 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 178/355] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:09 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1298 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:10.005505 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-39d68180-8357-4e71-8b6d-a316db276059 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:10.006630 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-39d68180-8357-4e71-8b6d-a316db276059 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:10.022273 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39d68180-8357-4e71-8b6d-a316db276059 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:10.026149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39d68180-8357-4e71-8b6d-a316db276059 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:10.027001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39d68180-8357-4e71-8b6d-a316db276059 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:10.032732 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39d68180-8357-4e71-8b6d-a316db276059 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:10.069737 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-e5469c8b-2f8b-4c08-9696-7826d0e4fd62 req-e50f85cc-2093-4fe4-9be7-f782c509f473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feed8b88-8df9-44a5-9520-0d723924fd1d", "tag": "d1dea7a4-f82d-4a04-9a13-0e5ac255e8b3"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:10.083372 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e5469c8b-2f8b-4c08-9696-7826d0e4fd62 req-e50f85cc-2093-4fe4-9be7-f782c509f473 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:10.084658 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e5469c8b-2f8b-4c08-9696-7826d0e4fd62 req-e50f85cc-2093-4fe4-9be7-f782c509f473 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:10.100584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-e5469c8b-2f8b-4c08-9696-7826d0e4fd62 req-e50f85cc-2093-4fe4-9be7-f782c509f473 service nova] Creating event network-changed:d1dea7a4-f82d-4a04-9a13-0e5ac255e8b3 for instance feed8b88-8df9-44a5-9520-0d723924fd1d on hv-cinder-84984 Jul 31 20:02:10.106873 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-e5469c8b-2f8b-4c08-9696-7826d0e4fd62 req-e50f85cc-2093-4fe4-9be7-f782c509f473 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041548 Jul 31 20:02:10.111490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 179/356] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:02:10.273704 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-01dac28f-e869-473a-af00-fb9131a3a599 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:10.274626 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-01dac28f-e869-473a-af00-fb9131a3a599 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:10.280142 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-39d68180-8357-4e71-8b6d-a316db276059 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:10.286172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01dac28f-e869-473a-af00-fb9131a3a599 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:10.287722 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01dac28f-e869-473a-af00-fb9131a3a599 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:10.290126 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01dac28f-e869-473a-af00-fb9131a3a599 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:10.290654 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01dac28f-e869-473a-af00-fb9131a3a599 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:10.291505 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-39d68180-8357-4e71-8b6d-a316db276059 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:10.293268 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-39d68180-8357-4e71-8b6d-a316db276059 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:10.294626 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-39d68180-8357-4e71-8b6d-a316db276059 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1739 microversion: 2.20 time: 0.293607 Jul 31 20:02:10.306273 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 178/357] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:09 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1739 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:10.490005 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9f8bff7e-292e-4f01-9e8a-c6445de4e233 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:10.492808 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9f8bff7e-292e-4f01-9e8a-c6445de4e233 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:10.502997 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f8bff7e-292e-4f01-9e8a-c6445de4e233 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:10.505937 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f8bff7e-292e-4f01-9e8a-c6445de4e233 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:10.506922 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f8bff7e-292e-4f01-9e8a-c6445de4e233 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:10.507423 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f8bff7e-292e-4f01-9e8a-c6445de4e233 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:10.822788 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-01dac28f-e869-473a-af00-fb9131a3a599 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:10.834237 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-01dac28f-e869-473a-af00-fb9131a3a599 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.565120 Jul 31 20:02:10.834802 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 180/358] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:10 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:10.847833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9f8bff7e-292e-4f01-9e8a-c6445de4e233 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:10.853033 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ba384d45-e8d1-4610-856f-518d360ee53e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:10.853887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ba384d45-e8d1-4610-856f-518d360ee53e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:10.857726 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9f8bff7e-292e-4f01-9e8a-c6445de4e233 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.370953 Jul 31 20:02:10.858343 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 179/359] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:10 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:10.861734 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba384d45-e8d1-4610-856f-518d360ee53e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:10.862923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba384d45-e8d1-4610-856f-518d360ee53e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:10.863870 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba384d45-e8d1-4610-856f-518d360ee53e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:10.865013 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba384d45-e8d1-4610-856f-518d360ee53e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:10.942022 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ba384d45-e8d1-4610-856f-518d360ee53e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:10.952227 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ba384d45-e8d1-4610-856f-518d360ee53e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1306 microversion: 2.1 time: 0.102944 Jul 31 20:02:10.952807 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 181/360] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:10 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:11.318400 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0a142715-7557-47d4-94e1-5139b97ce32a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:11.319001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0a142715-7557-47d4-94e1-5139b97ce32a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:11.328275 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0a142715-7557-47d4-94e1-5139b97ce32a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:11.329003 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0a142715-7557-47d4-94e1-5139b97ce32a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:11.330550 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0a142715-7557-47d4-94e1-5139b97ce32a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:11.331551 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0a142715-7557-47d4-94e1-5139b97ce32a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:11.567249 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0a142715-7557-47d4-94e1-5139b97ce32a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:11.579905 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0a142715-7557-47d4-94e1-5139b97ce32a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:11.581840 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0a142715-7557-47d4-94e1-5139b97ce32a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:11.583078 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0a142715-7557-47d4-94e1-5139b97ce32a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1739 microversion: 2.20 time: 0.268602 Jul 31 20:02:11.584019 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 180/361] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:11 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:11.614299 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-d7b269b5-66a3-4234-bff7-c476df753ec3 req-0b2a2fda-987c-437f-a232-7d7a5f07de59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0dc439c-b3b3-443c-8680-f7b1623dbe29", "name": "network-vif-plugged", "status": "completed", "tag": "63e21ff2-2376-43b2-97f2-7343a4970d01"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:11.635306 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d7b269b5-66a3-4234-bff7-c476df753ec3 req-0b2a2fda-987c-437f-a232-7d7a5f07de59 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:11.636032 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d7b269b5-66a3-4234-bff7-c476df753ec3 req-0b2a2fda-987c-437f-a232-7d7a5f07de59 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:11.660385 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-d7b269b5-66a3-4234-bff7-c476df753ec3 req-0b2a2fda-987c-437f-a232-7d7a5f07de59 service nova] Creating event network-vif-plugged:63e21ff2-2376-43b2-97f2-7343a4970d01 for instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 on hv-cinder-84984 Jul 31 20:02:11.667114 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-d7b269b5-66a3-4234-bff7-c476df753ec3 req-0b2a2fda-987c-437f-a232-7d7a5f07de59 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057599 Jul 31 20:02:11.668402 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 182/362] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:02:11.859033 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f2865998-aa70-4e90-92e4-64ed9a2bcefe tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:11.859941 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f2865998-aa70-4e90-92e4-64ed9a2bcefe tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:11.866858 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f2865998-aa70-4e90-92e4-64ed9a2bcefe tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:11.868137 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f2865998-aa70-4e90-92e4-64ed9a2bcefe tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:11.869349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f2865998-aa70-4e90-92e4-64ed9a2bcefe tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:11.870000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f2865998-aa70-4e90-92e4-64ed9a2bcefe tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:11.886244 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e834adeb-ecea-4149-8d31-df191c574b89 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:11.887064 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e834adeb-ecea-4149-8d31-df191c574b89 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:11.901646 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e834adeb-ecea-4149-8d31-df191c574b89 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:11.902085 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e834adeb-ecea-4149-8d31-df191c574b89 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:11.907014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e834adeb-ecea-4149-8d31-df191c574b89 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:11.911568 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e834adeb-ecea-4149-8d31-df191c574b89 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:12.170365 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f2865998-aa70-4e90-92e4-64ed9a2bcefe tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:12.172343 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e834adeb-ecea-4149-8d31-df191c574b89 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:12.178689 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f2865998-aa70-4e90-92e4-64ed9a2bcefe tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1722 microversion: 2.1 time: 0.327190 Jul 31 20:02:12.186533 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e834adeb-ecea-4149-8d31-df191c574b89 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.308006 Jul 31 20:02:12.187601 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 183/363] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:11 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:12.193751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 181/364] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:11 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:12.197365 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e23c6344-3faf-4c70-a321-5fb7847fb7fa tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:12.199814 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e23c6344-3faf-4c70-a321-5fb7847fb7fa tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:12.212474 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23c6344-3faf-4c70-a321-5fb7847fb7fa tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:12.213180 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23c6344-3faf-4c70-a321-5fb7847fb7fa tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:12.214163 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23c6344-3faf-4c70-a321-5fb7847fb7fa tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:12.214596 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23c6344-3faf-4c70-a321-5fb7847fb7fa tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:12.368543 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e23c6344-3faf-4c70-a321-5fb7847fb7fa tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:12.379933 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e23c6344-3faf-4c70-a321-5fb7847fb7fa tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1306 microversion: 2.1 time: 0.191022 Jul 31 20:02:12.380521 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 184/365] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:12 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1306 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:12.611428 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7e59fd26-2f0b-4bb8-82d7-9cdc290168dd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:12.612079 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7e59fd26-2f0b-4bb8-82d7-9cdc290168dd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:12.627009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e59fd26-2f0b-4bb8-82d7-9cdc290168dd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:12.627464 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e59fd26-2f0b-4bb8-82d7-9cdc290168dd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:12.628472 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e59fd26-2f0b-4bb8-82d7-9cdc290168dd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:12.630306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e59fd26-2f0b-4bb8-82d7-9cdc290168dd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:12.881483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7e59fd26-2f0b-4bb8-82d7-9cdc290168dd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:12.897401 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7e59fd26-2f0b-4bb8-82d7-9cdc290168dd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:12.899806 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7e59fd26-2f0b-4bb8-82d7-9cdc290168dd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:12.901182 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7e59fd26-2f0b-4bb8-82d7-9cdc290168dd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1739 microversion: 2.20 time: 0.294363 Jul 31 20:02:12.902726 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 182/366] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:12 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1739 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:13.203189 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-41644fd6-ff3b-4bdb-9904-59888e34f24d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:13.205403 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-41644fd6-ff3b-4bdb-9904-59888e34f24d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:13.212744 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41644fd6-ff3b-4bdb-9904-59888e34f24d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:13.213510 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41644fd6-ff3b-4bdb-9904-59888e34f24d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:13.214776 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41644fd6-ff3b-4bdb-9904-59888e34f24d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:13.215366 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41644fd6-ff3b-4bdb-9904-59888e34f24d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:13.225779 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ba648999-a4db-4870-bda2-346d5bccd424 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:13.226653 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ba648999-a4db-4870-bda2-346d5bccd424 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:13.236945 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ba648999-a4db-4870-bda2-346d5bccd424 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:13.237949 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ba648999-a4db-4870-bda2-346d5bccd424 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:13.238881 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ba648999-a4db-4870-bda2-346d5bccd424 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:13.239467 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ba648999-a4db-4870-bda2-346d5bccd424 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:13.688815 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ba648999-a4db-4870-bda2-346d5bccd424 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:13.692279 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-41644fd6-ff3b-4bdb-9904-59888e34f24d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:13.699286 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ba648999-a4db-4870-bda2-346d5bccd424 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.486962 Jul 31 20:02:13.701973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-41644fd6-ff3b-4bdb-9904-59888e34f24d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1699 microversion: 2.1 time: 0.503072 Jul 31 20:02:13.715874 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 183/367] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:13 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:13.719741 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 185/368] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:13 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1699 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:13.722703 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f4448c4c-d96f-4f43-8eef-6cad0aca7a5e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:13.728183 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f4448c4c-d96f-4f43-8eef-6cad0aca7a5e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:13.735134 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c8818c6b-bc32-4d5f-8022-45efa5f26c18 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:13.743919 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8818c6b-bc32-4d5f-8022-45efa5f26c18 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:13.745082 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8818c6b-bc32-4d5f-8022-45efa5f26c18 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:13.746683 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f4448c4c-d96f-4f43-8eef-6cad0aca7a5e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:13.748035 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f4448c4c-d96f-4f43-8eef-6cad0aca7a5e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:13.748826 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f4448c4c-d96f-4f43-8eef-6cad0aca7a5e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:13.753694 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f4448c4c-d96f-4f43-8eef-6cad0aca7a5e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:13.826558 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c8818c6b-bc32-4d5f-8022-45efa5f26c18 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Going to try to start instance {{(pid=117920) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 31 20:02:13.879799 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c8818c6b-bc32-4d5f-8022-45efa5f26c18 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "POST /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/action" status: 202 len: 0 microversion: 2.1 time: 0.153453 Jul 31 20:02:13.881361 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 186/369] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:02:13 2022] POST /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:02:13.890589 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ef450cde-17ca-4b33-ba84-e7612955e0db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:13.892268 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ef450cde-17ca-4b33-ba84-e7612955e0db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:13.892541 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f4448c4c-d96f-4f43-8eef-6cad0aca7a5e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:13.900366 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef450cde-17ca-4b33-ba84-e7612955e0db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:13.900968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef450cde-17ca-4b33-ba84-e7612955e0db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:13.901880 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef450cde-17ca-4b33-ba84-e7612955e0db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:13.903285 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef450cde-17ca-4b33-ba84-e7612955e0db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:13.913943 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f4448c4c-d96f-4f43-8eef-6cad0aca7a5e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1304 microversion: 2.1 time: 0.196630 Jul 31 20:02:13.914547 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 184/370] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:13 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1304 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:13.931961 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-46b920c7-1a82-444b-ab89-243d51d10ce5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:13.932819 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-46b920c7-1a82-444b-ab89-243d51d10ce5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:13.939359 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-46b920c7-1a82-444b-ab89-243d51d10ce5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:13.940039 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-46b920c7-1a82-444b-ab89-243d51d10ce5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:13.940965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-46b920c7-1a82-444b-ab89-243d51d10ce5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:13.941582 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-46b920c7-1a82-444b-ab89-243d51d10ce5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:14.238297 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ef450cde-17ca-4b33-ba84-e7612955e0db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:14.248643 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ef450cde-17ca-4b33-ba84-e7612955e0db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1708 microversion: 2.1 time: 0.363437 Jul 31 20:02:14.253009 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 187/371] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:13 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1708 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:14.337715 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-46b920c7-1a82-444b-ab89-243d51d10ce5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:14.347626 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-46b920c7-1a82-444b-ab89-243d51d10ce5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:14.349391 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-46b920c7-1a82-444b-ab89-243d51d10ce5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:14.350628 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-46b920c7-1a82-444b-ab89-243d51d10ce5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1739 microversion: 2.20 time: 0.422674 Jul 31 20:02:14.351988 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 185/372] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:13 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1739 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:14.723269 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6f91da76-40a3-4479-b9ca-0c2d396ece6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:14.724409 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6f91da76-40a3-4479-b9ca-0c2d396ece6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:14.731382 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f91da76-40a3-4479-b9ca-0c2d396ece6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:14.731927 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f91da76-40a3-4479-b9ca-0c2d396ece6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:14.733432 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f91da76-40a3-4479-b9ca-0c2d396ece6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:14.733967 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f91da76-40a3-4479-b9ca-0c2d396ece6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:14.921548 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6f91da76-40a3-4479-b9ca-0c2d396ece6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:14.925133 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6f91da76-40a3-4479-b9ca-0c2d396ece6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.207556 Jul 31 20:02:14.925701 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 188/373] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:14 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:14.935752 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3536a927-e2e8-4c4f-a6b2-891a8520e3d8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:14.936868 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3536a927-e2e8-4c4f-a6b2-891a8520e3d8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:14.946069 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3536a927-e2e8-4c4f-a6b2-891a8520e3d8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:14.947257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3536a927-e2e8-4c4f-a6b2-891a8520e3d8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:14.950150 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3536a927-e2e8-4c4f-a6b2-891a8520e3d8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:14.950150 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3536a927-e2e8-4c4f-a6b2-891a8520e3d8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:15.111409 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3536a927-e2e8-4c4f-a6b2-891a8520e3d8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:15.120618 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3536a927-e2e8-4c4f-a6b2-891a8520e3d8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.188600 Jul 31 20:02:15.121642 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 186/374] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:14 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:15.271820 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-99cf995f-276f-4641-ae87-4597858d207f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:15.273203 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-99cf995f-276f-4641-ae87-4597858d207f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:15.279852 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99cf995f-276f-4641-ae87-4597858d207f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:15.280499 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99cf995f-276f-4641-ae87-4597858d207f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:15.281479 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99cf995f-276f-4641-ae87-4597858d207f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:15.282071 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99cf995f-276f-4641-ae87-4597858d207f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:15.377918 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1abd6057-8761-4117-8d30-e7182d332e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:15.379514 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1abd6057-8761-4117-8d30-e7182d332e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:15.388630 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1abd6057-8761-4117-8d30-e7182d332e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:15.389569 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1abd6057-8761-4117-8d30-e7182d332e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:15.390336 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1abd6057-8761-4117-8d30-e7182d332e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:15.390762 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1abd6057-8761-4117-8d30-e7182d332e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:15.487116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-99cf995f-276f-4641-ae87-4597858d207f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:15.495712 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-99cf995f-276f-4641-ae87-4597858d207f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1708 microversion: 2.1 time: 0.227644 Jul 31 20:02:15.496430 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 189/375] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:15 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1708 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:15.562656 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1abd6057-8761-4117-8d30-e7182d332e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:15.571023 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1abd6057-8761-4117-8d30-e7182d332e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:15.572723 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1abd6057-8761-4117-8d30-e7182d332e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:15.574301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1abd6057-8761-4117-8d30-e7182d332e69 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1739 microversion: 2.20 time: 0.200303 Jul 31 20:02:15.589176 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 187/376] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:15 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:15.947370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-348284a4-244c-4880-9927-620fc040ac58 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:15.947968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-348284a4-244c-4880-9927-620fc040ac58 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:15.954716 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-348284a4-244c-4880-9927-620fc040ac58 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:15.955547 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-348284a4-244c-4880-9927-620fc040ac58 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:15.956948 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-348284a4-244c-4880-9927-620fc040ac58 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:15.957592 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-348284a4-244c-4880-9927-620fc040ac58 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:15.975451 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:16.118973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-348284a4-244c-4880-9927-620fc040ac58 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:16.127254 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-348284a4-244c-4880-9927-620fc040ac58 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.183681 Jul 31 20:02:16.127825 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 190/377] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:15 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:16.141171 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e811dc8d-ab59-4fb4-a727-eadc334d8659 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:16.141768 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e811dc8d-ab59-4fb4-a727-eadc334d8659 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:16.148900 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e811dc8d-ab59-4fb4-a727-eadc334d8659 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:16.149630 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e811dc8d-ab59-4fb4-a727-eadc334d8659 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:16.150644 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e811dc8d-ab59-4fb4-a727-eadc334d8659 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:16.151068 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e811dc8d-ab59-4fb4-a727-eadc334d8659 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:16.293232 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e811dc8d-ab59-4fb4-a727-eadc334d8659 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:16.301445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e811dc8d-ab59-4fb4-a727-eadc334d8659 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.164298 Jul 31 20:02:16.302303 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 188/378] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:16 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:16.521422 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-18ac39dd-339b-4fec-953e-7d788bf7a79d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:16.523117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-18ac39dd-339b-4fec-953e-7d788bf7a79d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:16.528833 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18ac39dd-339b-4fec-953e-7d788bf7a79d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:16.529325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18ac39dd-339b-4fec-953e-7d788bf7a79d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:16.530151 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18ac39dd-339b-4fec-953e-7d788bf7a79d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:16.530582 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18ac39dd-339b-4fec-953e-7d788bf7a79d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:16.597530 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b6858ce3-8ed5-4864-863a-fa599967f173 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:16.598333 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b6858ce3-8ed5-4864-863a-fa599967f173 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:16.604386 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6858ce3-8ed5-4864-863a-fa599967f173 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:16.604818 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6858ce3-8ed5-4864-863a-fa599967f173 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:16.605781 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6858ce3-8ed5-4864-863a-fa599967f173 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:16.606354 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6858ce3-8ed5-4864-863a-fa599967f173 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:16.783878 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-18ac39dd-339b-4fec-953e-7d788bf7a79d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:16.802576 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-18ac39dd-339b-4fec-953e-7d788bf7a79d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1708 microversion: 2.1 time: 0.283944 Jul 31 20:02:16.803955 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 191/379] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:16 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1708 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:16.910699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b6858ce3-8ed5-4864-863a-fa599967f173 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:16.923276 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b6858ce3-8ed5-4864-863a-fa599967f173 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:16.924775 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b6858ce3-8ed5-4864-863a-fa599967f173 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:16.925960 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b6858ce3-8ed5-4864-863a-fa599967f173 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1739 microversion: 2.20 time: 0.332335 Jul 31 20:02:16.942685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 189/380] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:16 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1739 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:17.149253 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0851cb99-f7cd-4ecc-8a6a-aa806f620213 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:17.149867 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0851cb99-f7cd-4ecc-8a6a-aa806f620213 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:17.156477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0851cb99-f7cd-4ecc-8a6a-aa806f620213 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:17.156957 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0851cb99-f7cd-4ecc-8a6a-aa806f620213 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:17.157909 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0851cb99-f7cd-4ecc-8a6a-aa806f620213 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:17.158505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0851cb99-f7cd-4ecc-8a6a-aa806f620213 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:17.323316 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-25a78751-4086-4d85-ad02-0e8fdc4805ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:17.324560 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-25a78751-4086-4d85-ad02-0e8fdc4805ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:17.333832 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25a78751-4086-4d85-ad02-0e8fdc4805ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:17.337365 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25a78751-4086-4d85-ad02-0e8fdc4805ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:17.338208 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25a78751-4086-4d85-ad02-0e8fdc4805ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:17.338822 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25a78751-4086-4d85-ad02-0e8fdc4805ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:17.403653 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0851cb99-f7cd-4ecc-8a6a-aa806f620213 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:17.412829 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0851cb99-f7cd-4ecc-8a6a-aa806f620213 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.268547 Jul 31 20:02:17.413427 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 192/381] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:17 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:17.593005 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-25a78751-4086-4d85-ad02-0e8fdc4805ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:17.602457 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-25a78751-4086-4d85-ad02-0e8fdc4805ca tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.283343 Jul 31 20:02:17.615478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 190/382] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:17 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:17.692744 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-06f9bea9-8596-4fb4-8518-86869a86a867 req-cee096cd-7017-4ab3-8287-19ae0112c6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac54baf-9c5e-4774-be4a-78b89959104f", "tag": "4b015db4-1121-4b9d-8f46-45643ea431bf"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:17.697641 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:17.704661 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-06f9bea9-8596-4fb4-8518-86869a86a867 req-cee096cd-7017-4ab3-8287-19ae0112c6a6 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:17.705145 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-06f9bea9-8596-4fb4-8518-86869a86a867 req-cee096cd-7017-4ab3-8287-19ae0112c6a6 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:17.716847 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-06f9bea9-8596-4fb4-8518-86869a86a867 req-cee096cd-7017-4ab3-8287-19ae0112c6a6 service nova] Creating event network-changed:4b015db4-1121-4b9d-8f46-45643ea431bf for instance bac54baf-9c5e-4774-be4a-78b89959104f on hv-cinder-84984 Jul 31 20:02:17.722059 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-06f9bea9-8596-4fb4-8518-86869a86a867 req-cee096cd-7017-4ab3-8287-19ae0112c6a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032931 Jul 31 20:02:17.723391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 193/383] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:02:17.826690 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c0a29897-ce19-4b32-b4a4-3d2ff5c53774 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:17.827966 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c0a29897-ce19-4b32-b4a4-3d2ff5c53774 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:17.835705 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0a29897-ce19-4b32-b4a4-3d2ff5c53774 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:17.836029 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0a29897-ce19-4b32-b4a4-3d2ff5c53774 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:17.836802 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0a29897-ce19-4b32-b4a4-3d2ff5c53774 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:17.837272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0a29897-ce19-4b32-b4a4-3d2ff5c53774 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:17.950884 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ae962dd5-3957-4702-a5fd-308aede68324 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:17.951879 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ae962dd5-3957-4702-a5fd-308aede68324 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:17.958962 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae962dd5-3957-4702-a5fd-308aede68324 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:17.959733 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae962dd5-3957-4702-a5fd-308aede68324 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:17.960633 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae962dd5-3957-4702-a5fd-308aede68324 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:17.961310 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae962dd5-3957-4702-a5fd-308aede68324 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:17.993400 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c0a29897-ce19-4b32-b4a4-3d2ff5c53774 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:18.002615 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c0a29897-ce19-4b32-b4a4-3d2ff5c53774 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1708 microversion: 2.1 time: 0.182330 Jul 31 20:02:18.018521 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 191/384] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:17 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1708 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:18.182877 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:18.365509 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=12 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:18.433849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-95899fd6-2422-4a6a-90d2-fd4b8721b6da tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:18.435131 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-95899fd6-2422-4a6a-90d2-fd4b8721b6da tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:18.438886 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ae962dd5-3957-4702-a5fd-308aede68324 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:18.448452 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95899fd6-2422-4a6a-90d2-fd4b8721b6da tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:18.449399 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95899fd6-2422-4a6a-90d2-fd4b8721b6da tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:18.449612 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ae962dd5-3957-4702-a5fd-308aede68324 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:18.450351 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95899fd6-2422-4a6a-90d2-fd4b8721b6da tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:18.450775 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95899fd6-2422-4a6a-90d2-fd4b8721b6da tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:18.452457 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ae962dd5-3957-4702-a5fd-308aede68324 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:18.453866 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ae962dd5-3957-4702-a5fd-308aede68324 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1739 microversion: 2.20 time: 0.507407 Jul 31 20:02:18.454881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 194/385] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:17 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1739 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:18.479141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:18.625893 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-79969682-6f0b-48ac-93e8-1aaca74162c3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:18.626804 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-79969682-6f0b-48ac-93e8-1aaca74162c3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:18.631407 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-95899fd6-2422-4a6a-90d2-fd4b8721b6da tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:18.643100 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79969682-6f0b-48ac-93e8-1aaca74162c3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:18.643308 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-95899fd6-2422-4a6a-90d2-fd4b8721b6da tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.213174 Jul 31 20:02:18.644814 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79969682-6f0b-48ac-93e8-1aaca74162c3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:18.646991 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79969682-6f0b-48ac-93e8-1aaca74162c3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:18.647587 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79969682-6f0b-48ac-93e8-1aaca74162c3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:18.657899 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 192/386] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:18 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:18.830678 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-79969682-6f0b-48ac-93e8-1aaca74162c3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:18.840077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-79969682-6f0b-48ac-93e8-1aaca74162c3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.220977 Jul 31 20:02:18.840870 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 195/387] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:18 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:19.026036 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-437f1d30-9956-4acc-b8cc-6bc031248088 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:19.026645 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-437f1d30-9956-4acc-b8cc-6bc031248088 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:19.034113 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:19.036862 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-437f1d30-9956-4acc-b8cc-6bc031248088 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:19.037250 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-437f1d30-9956-4acc-b8cc-6bc031248088 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:19.038029 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-437f1d30-9956-4acc-b8cc-6bc031248088 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:19.038640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-437f1d30-9956-4acc-b8cc-6bc031248088 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:19.218903 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-437f1d30-9956-4acc-b8cc-6bc031248088 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:19.227842 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-437f1d30-9956-4acc-b8cc-6bc031248088 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1708 microversion: 2.1 time: 0.205666 Jul 31 20:02:19.229589 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 193/388] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:19 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1708 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:19.479145 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9b86168a-d1b9-42b5-8232-8b14671c1a0b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:19.480374 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9b86168a-d1b9-42b5-8232-8b14671c1a0b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:19.488076 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b86168a-d1b9-42b5-8232-8b14671c1a0b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:19.488813 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b86168a-d1b9-42b5-8232-8b14671c1a0b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:19.489990 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b86168a-d1b9-42b5-8232-8b14671c1a0b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:19.490609 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b86168a-d1b9-42b5-8232-8b14671c1a0b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:19.648705 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b86168a-d1b9-42b5-8232-8b14671c1a0b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:19.669678 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b86168a-d1b9-42b5-8232-8b14671c1a0b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:19.669678 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b86168a-d1b9-42b5-8232-8b14671c1a0b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:19.669678 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9b86168a-d1b9-42b5-8232-8b14671c1a0b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1739 microversion: 2.20 time: 0.186237 Jul 31 20:02:19.670629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 196/389] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:19 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:19.676401 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d40f1508-0b25-47a5-a14c-42f1ab892487 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:19.678260 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d40f1508-0b25-47a5-a14c-42f1ab892487 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:19.685400 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d40f1508-0b25-47a5-a14c-42f1ab892487 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:19.686027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d40f1508-0b25-47a5-a14c-42f1ab892487 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:19.686922 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d40f1508-0b25-47a5-a14c-42f1ab892487 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:19.687350 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d40f1508-0b25-47a5-a14c-42f1ab892487 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:19.834700 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d40f1508-0b25-47a5-a14c-42f1ab892487 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:19.845199 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d40f1508-0b25-47a5-a14c-42f1ab892487 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1266 microversion: 2.1 time: 0.173638 Jul 31 20:02:19.845863 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 194/390] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:19 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:19.862605 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2b9b7028-b179-4ebf-81a8-dabd4b28beb3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:19.863216 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2b9b7028-b179-4ebf-81a8-dabd4b28beb3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:19.869844 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b9b7028-b179-4ebf-81a8-dabd4b28beb3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:19.870291 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b9b7028-b179-4ebf-81a8-dabd4b28beb3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:19.871065 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b9b7028-b179-4ebf-81a8-dabd4b28beb3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:19.871495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b9b7028-b179-4ebf-81a8-dabd4b28beb3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:20.024453 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2b9b7028-b179-4ebf-81a8-dabd4b28beb3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:20.032538 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2b9b7028-b179-4ebf-81a8-dabd4b28beb3 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.173705 Jul 31 20:02:20.033445 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 197/391] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:19 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:20.257664 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-635d511b-4502-4478-9af9-8dd1da6b32f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:20.258427 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-635d511b-4502-4478-9af9-8dd1da6b32f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:20.286344 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-635d511b-4502-4478-9af9-8dd1da6b32f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:20.287821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-635d511b-4502-4478-9af9-8dd1da6b32f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:20.290211 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-635d511b-4502-4478-9af9-8dd1da6b32f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:20.297757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-635d511b-4502-4478-9af9-8dd1da6b32f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:20.598220 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-635d511b-4502-4478-9af9-8dd1da6b32f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:20.614113 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-635d511b-4502-4478-9af9-8dd1da6b32f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1708 microversion: 2.1 time: 0.363889 Jul 31 20:02:20.614969 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 195/392] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:20 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1708 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:20.711609 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2f81bd60-478a-4fd4-ba84-5603dae075e7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:20.712491 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2f81bd60-478a-4fd4-ba84-5603dae075e7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:20.718777 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f81bd60-478a-4fd4-ba84-5603dae075e7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:20.719535 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f81bd60-478a-4fd4-ba84-5603dae075e7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:20.720517 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f81bd60-478a-4fd4-ba84-5603dae075e7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:20.721182 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f81bd60-478a-4fd4-ba84-5603dae075e7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:20.867805 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-84134aa2-c1c1-492d-b5a6-4d13c3ee8fba tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:20.869593 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-84134aa2-c1c1-492d-b5a6-4d13c3ee8fba tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:20.888229 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84134aa2-c1c1-492d-b5a6-4d13c3ee8fba tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:20.888951 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84134aa2-c1c1-492d-b5a6-4d13c3ee8fba tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:20.892844 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84134aa2-c1c1-492d-b5a6-4d13c3ee8fba tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:20.893530 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84134aa2-c1c1-492d-b5a6-4d13c3ee8fba tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:21.113326 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2f81bd60-478a-4fd4-ba84-5603dae075e7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:21.125801 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2f81bd60-478a-4fd4-ba84-5603dae075e7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:21.128222 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2f81bd60-478a-4fd4-ba84-5603dae075e7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:21.130247 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2f81bd60-478a-4fd4-ba84-5603dae075e7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1739 microversion: 2.20 time: 0.425012 Jul 31 20:02:21.131288 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 198/393] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:20 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1739 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:21.154913 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-32871f43-262c-4709-b6b6-f960fcf75c49 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:21.156040 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-32871f43-262c-4709-b6b6-f960fcf75c49 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:21.163352 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32871f43-262c-4709-b6b6-f960fcf75c49 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:21.163872 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32871f43-262c-4709-b6b6-f960fcf75c49 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:21.164676 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32871f43-262c-4709-b6b6-f960fcf75c49 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:21.165105 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32871f43-262c-4709-b6b6-f960fcf75c49 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:21.196009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-84134aa2-c1c1-492d-b5a6-4d13c3ee8fba tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:21.208328 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-84134aa2-c1c1-492d-b5a6-4d13c3ee8fba tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1453 microversion: 2.1 time: 0.345788 Jul 31 20:02:21.208918 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 196/394] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:20 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1453 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:21.230848 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-432113ed-b9fa-4ca9-8b72-6d8c3d9c2f3f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:21.231695 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-432113ed-b9fa-4ca9-8b72-6d8c3d9c2f3f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:21.238354 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-432113ed-b9fa-4ca9-8b72-6d8c3d9c2f3f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:21.239102 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-432113ed-b9fa-4ca9-8b72-6d8c3d9c2f3f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:21.240054 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-432113ed-b9fa-4ca9-8b72-6d8c3d9c2f3f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:21.240633 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-432113ed-b9fa-4ca9-8b72-6d8c3d9c2f3f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:21.636255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-32871f43-262c-4709-b6b6-f960fcf75c49 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:21.650285 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-32871f43-262c-4709-b6b6-f960fcf75c49 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.502133 Jul 31 20:02:21.651515 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 199/395] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:21 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:21.662950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f42e3672-3739-4837-bc00-c486d4e761a0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:21.663784 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f42e3672-3739-4837-bc00-c486d4e761a0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:21.667141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-432113ed-b9fa-4ca9-8b72-6d8c3d9c2f3f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:21.675153 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-432113ed-b9fa-4ca9-8b72-6d8c3d9c2f3f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1453 microversion: 2.1 time: 0.448189 Jul 31 20:02:21.675807 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f42e3672-3739-4837-bc00-c486d4e761a0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:21.676252 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f42e3672-3739-4837-bc00-c486d4e761a0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:21.676905 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 197/396] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:21 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1453 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:21.690019 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f42e3672-3739-4837-bc00-c486d4e761a0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:21.690479 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f42e3672-3739-4837-bc00-c486d4e761a0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:22.034755 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f42e3672-3739-4837-bc00-c486d4e761a0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:22.044075 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f42e3672-3739-4837-bc00-c486d4e761a0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1708 microversion: 2.1 time: 0.391362 Jul 31 20:02:22.044939 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 200/397] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:21 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1708 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:22.159425 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b5396148-eea3-42d2-9116-1a489f2d8dea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:22.159982 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b5396148-eea3-42d2-9116-1a489f2d8dea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:22.167031 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5396148-eea3-42d2-9116-1a489f2d8dea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:22.167478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5396148-eea3-42d2-9116-1a489f2d8dea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:22.168244 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5396148-eea3-42d2-9116-1a489f2d8dea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:22.168662 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5396148-eea3-42d2-9116-1a489f2d8dea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:22.305597 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b5396148-eea3-42d2-9116-1a489f2d8dea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:22.316363 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b5396148-eea3-42d2-9116-1a489f2d8dea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:22.317922 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b5396148-eea3-42d2-9116-1a489f2d8dea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:22.319122 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b5396148-eea3-42d2-9116-1a489f2d8dea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1721 microversion: 2.20 time: 0.163872 Jul 31 20:02:22.319664 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 198/398] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:22 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:22.671259 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3c0ab7e1-559e-427b-8094-fca9ab7119f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:22.671867 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3c0ab7e1-559e-427b-8094-fca9ab7119f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:22.681746 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c0ab7e1-559e-427b-8094-fca9ab7119f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:22.682129 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c0ab7e1-559e-427b-8094-fca9ab7119f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:22.682940 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c0ab7e1-559e-427b-8094-fca9ab7119f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:22.683325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c0ab7e1-559e-427b-8094-fca9ab7119f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:22.833127 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3c0ab7e1-559e-427b-8094-fca9ab7119f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:22.842503 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3c0ab7e1-559e-427b-8094-fca9ab7119f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.175060 Jul 31 20:02:22.843676 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 201/399] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:22 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:23.066521 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-05d89e1c-fe45-4f7c-a93d-6c5f8a860a6d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:23.067179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-05d89e1c-fe45-4f7c-a93d-6c5f8a860a6d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:23.073573 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-05d89e1c-fe45-4f7c-a93d-6c5f8a860a6d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:23.074011 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-05d89e1c-fe45-4f7c-a93d-6c5f8a860a6d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:23.074821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-05d89e1c-fe45-4f7c-a93d-6c5f8a860a6d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:23.075246 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-05d89e1c-fe45-4f7c-a93d-6c5f8a860a6d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:23.221957 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-05d89e1c-fe45-4f7c-a93d-6c5f8a860a6d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:23.230944 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-05d89e1c-fe45-4f7c-a93d-6c5f8a860a6d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1708 microversion: 2.1 time: 0.168656 Jul 31 20:02:23.231653 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 199/400] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:23 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1708 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:23.344796 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c97984a9-ceac-430a-bc7b-25c9570a3ab6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:23.345790 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c97984a9-ceac-430a-bc7b-25c9570a3ab6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:23.355806 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c97984a9-ceac-430a-bc7b-25c9570a3ab6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:23.356843 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c97984a9-ceac-430a-bc7b-25c9570a3ab6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:23.358551 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c97984a9-ceac-430a-bc7b-25c9570a3ab6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:23.359202 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c97984a9-ceac-430a-bc7b-25c9570a3ab6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:23.571494 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c97984a9-ceac-430a-bc7b-25c9570a3ab6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:23.583736 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c97984a9-ceac-430a-bc7b-25c9570a3ab6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:23.592293 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c97984a9-ceac-430a-bc7b-25c9570a3ab6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:23.594176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c97984a9-ceac-430a-bc7b-25c9570a3ab6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1721 microversion: 2.20 time: 0.254921 Jul 31 20:02:23.598919 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 202/401] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:23 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:23.872208 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-900fd7e0-0f1e-46ca-b8b7-3f19a0e506bc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:23.873667 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-900fd7e0-0f1e-46ca-b8b7-3f19a0e506bc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:23.883639 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-900fd7e0-0f1e-46ca-b8b7-3f19a0e506bc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:23.885305 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-900fd7e0-0f1e-46ca-b8b7-3f19a0e506bc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:23.886662 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-900fd7e0-0f1e-46ca-b8b7-3f19a0e506bc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:23.887324 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-900fd7e0-0f1e-46ca-b8b7-3f19a0e506bc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:24.126040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-900fd7e0-0f1e-46ca-b8b7-3f19a0e506bc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:24.139025 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-900fd7e0-0f1e-46ca-b8b7-3f19a0e506bc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.277417 Jul 31 20:02:24.141213 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 200/402] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:23 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:24.253057 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-26df2fef-a86e-4d1f-b6ff-0564b965dd62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:24.254330 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-26df2fef-a86e-4d1f-b6ff-0564b965dd62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:24.261409 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26df2fef-a86e-4d1f-b6ff-0564b965dd62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:24.262421 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26df2fef-a86e-4d1f-b6ff-0564b965dd62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:24.263400 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26df2fef-a86e-4d1f-b6ff-0564b965dd62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:24.264235 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26df2fef-a86e-4d1f-b6ff-0564b965dd62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:24.467629 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-8cbaf53a-e7e2-434c-a462-db62dc361895 req-1d969733-42b5-4aa3-a406-810727b6b1fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0dc439c-b3b3-443c-8680-f7b1623dbe29", "tag": "63e21ff2-2376-43b2-97f2-7343a4970d01"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:24.481593 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-8cbaf53a-e7e2-434c-a462-db62dc361895 req-1d969733-42b5-4aa3-a406-810727b6b1fa service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:24.488251 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-8cbaf53a-e7e2-434c-a462-db62dc361895 req-1d969733-42b5-4aa3-a406-810727b6b1fa service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:24.513133 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-8cbaf53a-e7e2-434c-a462-db62dc361895 req-1d969733-42b5-4aa3-a406-810727b6b1fa service nova] Creating event network-changed:63e21ff2-2376-43b2-97f2-7343a4970d01 for instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 on hv-cinder-84984 Jul 31 20:02:24.524098 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-8cbaf53a-e7e2-434c-a462-db62dc361895 req-1d969733-42b5-4aa3-a406-810727b6b1fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058733 Jul 31 20:02:24.526324 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 201/403] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:02:24.625312 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-805a17d3-70b1-4844-90d9-29aa7c2df998 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:24.626078 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-805a17d3-70b1-4844-90d9-29aa7c2df998 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:24.637100 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-805a17d3-70b1-4844-90d9-29aa7c2df998 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:24.640008 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-805a17d3-70b1-4844-90d9-29aa7c2df998 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:24.641219 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-805a17d3-70b1-4844-90d9-29aa7c2df998 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:24.649335 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-805a17d3-70b1-4844-90d9-29aa7c2df998 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:25.184173 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-26df2fef-a86e-4d1f-b6ff-0564b965dd62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:25.197547 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-26df2fef-a86e-4d1f-b6ff-0564b965dd62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1708 microversion: 2.1 time: 0.948366 Jul 31 20:02:25.198753 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 203/404] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:24 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1708 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:25.205397 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6377ecf2-c65e-4118-8ab1-984802e00517 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:25.206397 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6377ecf2-c65e-4118-8ab1-984802e00517 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:25.217344 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6377ecf2-c65e-4118-8ab1-984802e00517 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:25.217914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6377ecf2-c65e-4118-8ab1-984802e00517 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:25.218761 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6377ecf2-c65e-4118-8ab1-984802e00517 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:25.220074 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6377ecf2-c65e-4118-8ab1-984802e00517 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:25.419011 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-805a17d3-70b1-4844-90d9-29aa7c2df998 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:25.429391 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-805a17d3-70b1-4844-90d9-29aa7c2df998 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:25.430926 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-805a17d3-70b1-4844-90d9-29aa7c2df998 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:25.433378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-805a17d3-70b1-4844-90d9-29aa7c2df998 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1721 microversion: 2.20 time: 0.814179 Jul 31 20:02:25.434179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 202/405] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:24 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1721 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:25.532004 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6377ecf2-c65e-4118-8ab1-984802e00517 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:25.543861 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6377ecf2-c65e-4118-8ab1-984802e00517 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.343225 Jul 31 20:02:25.544460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 204/406] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:25 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:26.053969 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-5b9f618f-5ccf-4914-b81a-e0c44596f94e req-0b657ca2-ebb2-4e11-bce5-c8ef067748c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb0b91c-9a78-49a1-a96b-016c09759655", "name": "network-vif-unplugged", "status": "completed", "tag": "eaea7f4e-af98-4acb-9edb-366b7b6e28d8"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:26.075234 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5b9f618f-5ccf-4914-b81a-e0c44596f94e req-0b657ca2-ebb2-4e11-bce5-c8ef067748c5 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:26.077667 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5b9f618f-5ccf-4914-b81a-e0c44596f94e req-0b657ca2-ebb2-4e11-bce5-c8ef067748c5 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:26.102523 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-5b9f618f-5ccf-4914-b81a-e0c44596f94e req-0b657ca2-ebb2-4e11-bce5-c8ef067748c5 service nova] Creating event network-vif-unplugged:eaea7f4e-af98-4acb-9edb-366b7b6e28d8 for instance cdb0b91c-9a78-49a1-a96b-016c09759655 on hv-cinder-84984 Jul 31 20:02:26.108148 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-5b9f618f-5ccf-4914-b81a-e0c44596f94e req-0b657ca2-ebb2-4e11-bce5-c8ef067748c5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058708 Jul 31 20:02:26.108792 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 203/407] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:02:26.227185 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0d722329-6924-40a6-a814-6fd210331540 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:26.228228 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0d722329-6924-40a6-a814-6fd210331540 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:26.236655 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d722329-6924-40a6-a814-6fd210331540 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:26.237977 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d722329-6924-40a6-a814-6fd210331540 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:26.238890 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d722329-6924-40a6-a814-6fd210331540 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:26.239529 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d722329-6924-40a6-a814-6fd210331540 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:26.456416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6062a9c1-f62f-41ad-9e69-5d1d80087ace tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:26.457176 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6062a9c1-f62f-41ad-9e69-5d1d80087ace tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:26.468183 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6062a9c1-f62f-41ad-9e69-5d1d80087ace tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:26.468777 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6062a9c1-f62f-41ad-9e69-5d1d80087ace tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:26.469738 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6062a9c1-f62f-41ad-9e69-5d1d80087ace tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:26.470157 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6062a9c1-f62f-41ad-9e69-5d1d80087ace tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:26.765606 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0d722329-6924-40a6-a814-6fd210331540 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:26.775413 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0d722329-6924-40a6-a814-6fd210331540 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1712 microversion: 2.1 time: 0.560012 Jul 31 20:02:26.797882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 205/408] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:26 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1712 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:26.804291 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-750ad876-b576-4da7-869a-432c919baaed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:26.805498 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-750ad876-b576-4da7-869a-432c919baaed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:26.819462 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-750ad876-b576-4da7-869a-432c919baaed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:26.820263 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-750ad876-b576-4da7-869a-432c919baaed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:26.821562 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-750ad876-b576-4da7-869a-432c919baaed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:26.822146 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-750ad876-b576-4da7-869a-432c919baaed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:26.887555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6062a9c1-f62f-41ad-9e69-5d1d80087ace tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:26.896424 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6062a9c1-f62f-41ad-9e69-5d1d80087ace tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:26.898332 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6062a9c1-f62f-41ad-9e69-5d1d80087ace tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:26.899547 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6062a9c1-f62f-41ad-9e69-5d1d80087ace tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1721 microversion: 2.20 time: 0.447445 Jul 31 20:02:26.900098 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 204/409] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:26 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1721 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:02:26.984308 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-750ad876-b576-4da7-869a-432c919baaed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:26.992339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-750ad876-b576-4da7-869a-432c919baaed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.192978 Jul 31 20:02:26.992877 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 206/410] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:26 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:27.923374 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-af86e44d-91fb-4c83-913f-b8acf5a05fb9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:27.923984 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-af86e44d-91fb-4c83-913f-b8acf5a05fb9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:27.930808 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af86e44d-91fb-4c83-913f-b8acf5a05fb9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:27.931250 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af86e44d-91fb-4c83-913f-b8acf5a05fb9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:27.932313 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af86e44d-91fb-4c83-913f-b8acf5a05fb9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:27.932910 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af86e44d-91fb-4c83-913f-b8acf5a05fb9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:28.014868 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-80faf17c-66cb-4221-bce6-2c42390bdfc6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:28.016161 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-80faf17c-66cb-4221-bce6-2c42390bdfc6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:28.023621 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80faf17c-66cb-4221-bce6-2c42390bdfc6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:28.024127 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80faf17c-66cb-4221-bce6-2c42390bdfc6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:28.025583 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80faf17c-66cb-4221-bce6-2c42390bdfc6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:28.026032 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80faf17c-66cb-4221-bce6-2c42390bdfc6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:28.271492 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-af86e44d-91fb-4c83-913f-b8acf5a05fb9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:28.283804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-af86e44d-91fb-4c83-913f-b8acf5a05fb9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:28.287678 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-af86e44d-91fb-4c83-913f-b8acf5a05fb9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:28.289125 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-af86e44d-91fb-4c83-913f-b8acf5a05fb9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1721 microversion: 2.20 time: 0.369878 Jul 31 20:02:28.289702 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 205/411] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:27 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1721 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:28.295449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-80faf17c-66cb-4221-bce6-2c42390bdfc6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:28.299671 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:28.318267 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-80faf17c-66cb-4221-bce6-2c42390bdfc6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.307298 Jul 31 20:02:28.320265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 207/412] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:28 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:29.315737 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-82ddfebf-0c36-42d0-a26e-316f0acda272 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:29.316460 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-82ddfebf-0c36-42d0-a26e-316f0acda272 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:29.325844 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82ddfebf-0c36-42d0-a26e-316f0acda272 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:29.326810 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82ddfebf-0c36-42d0-a26e-316f0acda272 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:29.327638 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82ddfebf-0c36-42d0-a26e-316f0acda272 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:29.328086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82ddfebf-0c36-42d0-a26e-316f0acda272 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:29.342326 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1327e589-1c1c-4313-a918-24786dc34ebe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:29.342900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1327e589-1c1c-4313-a918-24786dc34ebe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:29.356440 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1327e589-1c1c-4313-a918-24786dc34ebe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:29.357944 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1327e589-1c1c-4313-a918-24786dc34ebe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:29.359321 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1327e589-1c1c-4313-a918-24786dc34ebe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:29.370003 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1327e589-1c1c-4313-a918-24786dc34ebe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:29.617349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-82ddfebf-0c36-42d0-a26e-316f0acda272 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:29.627932 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1327e589-1c1c-4313-a918-24786dc34ebe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:29.638309 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1327e589-1c1c-4313-a918-24786dc34ebe tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.302572 Jul 31 20:02:29.638461 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-82ddfebf-0c36-42d0-a26e-316f0acda272 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:29.639862 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-82ddfebf-0c36-42d0-a26e-316f0acda272 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:29.641023 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-82ddfebf-0c36-42d0-a26e-316f0acda272 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1721 microversion: 2.20 time: 0.332917 Jul 31 20:02:29.644123 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 208/413] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:29 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:29.648276 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 206/414] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:29 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1721 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:30.661617 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0f2b7130-abf1-46ef-841a-fcc1c4ecf145 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:30.663386 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0f2b7130-abf1-46ef-841a-fcc1c4ecf145 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:30.673086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-76bcab4f-9640-4048-88d9-08c79f5660ec tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:30.674528 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f2b7130-abf1-46ef-841a-fcc1c4ecf145 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:30.675471 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f2b7130-abf1-46ef-841a-fcc1c4ecf145 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:30.676082 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-76bcab4f-9640-4048-88d9-08c79f5660ec tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:30.676387 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f2b7130-abf1-46ef-841a-fcc1c4ecf145 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:30.676904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f2b7130-abf1-46ef-841a-fcc1c4ecf145 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:30.688713 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76bcab4f-9640-4048-88d9-08c79f5660ec tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:30.689449 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76bcab4f-9640-4048-88d9-08c79f5660ec tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:30.690437 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76bcab4f-9640-4048-88d9-08c79f5660ec tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:30.691019 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76bcab4f-9640-4048-88d9-08c79f5660ec tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:30.944063 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0f2b7130-abf1-46ef-841a-fcc1c4ecf145 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:30.952458 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0f2b7130-abf1-46ef-841a-fcc1c4ecf145 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.297186 Jul 31 20:02:30.966005 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 209/415] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:30 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:30.979367 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-76bcab4f-9640-4048-88d9-08c79f5660ec tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:30.991019 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-76bcab4f-9640-4048-88d9-08c79f5660ec tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:30.996026 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-76bcab4f-9640-4048-88d9-08c79f5660ec tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:30.998214 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-76bcab4f-9640-4048-88d9-08c79f5660ec tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1664 microversion: 2.20 time: 0.330763 Jul 31 20:02:30.999277 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 207/416] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:30 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1664 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:31.022287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aaf8d469-97d8-47b9-992a-9dc9062816e9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84187333-84b3-4887-8b53-a368217d525e"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:31.024934 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aaf8d469-97d8-47b9-992a-9dc9062816e9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:31.048417 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aaf8d469-97d8-47b9-992a-9dc9062816e9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:31.049265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aaf8d469-97d8-47b9-992a-9dc9062816e9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:31.050316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aaf8d469-97d8-47b9-992a-9dc9062816e9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:31.050949 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aaf8d469-97d8-47b9-992a-9dc9062816e9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:31.510361 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aaf8d469-97d8-47b9-992a-9dc9062816e9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "POST /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.492258 Jul 31 20:02:31.511632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 210/417] 10.222.0.48 () {62 vars in 1364 bytes} [Sun Jul 31 20:02:31 2022] POST /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-volume_attachments => generated 188 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 20:02:31.765105 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e2ef6800-12f2-4921-8fc7-c2b727ca1679 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:31.766627 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e2ef6800-12f2-4921-8fc7-c2b727ca1679 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:31.774866 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e2ef6800-12f2-4921-8fc7-c2b727ca1679 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:31.775694 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e2ef6800-12f2-4921-8fc7-c2b727ca1679 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:31.776976 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e2ef6800-12f2-4921-8fc7-c2b727ca1679 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:31.777618 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e2ef6800-12f2-4921-8fc7-c2b727ca1679 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:31.832626 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e2ef6800-12f2-4921-8fc7-c2b727ca1679 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117919) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 20:02:31.969911 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e2ef6800-12f2-4921-8fc7-c2b727ca1679 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "POST /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/action" status: 202 len: 0 microversion: 2.20 time: 0.215582 Jul 31 20:02:31.970528 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 208/418] 10.222.0.48 () {62 vars in 1319 bytes} [Sun Jul 31 20:02:31 2022] POST /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:02:31.978966 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3896d850-1c3e-47cf-b105-492cc819ada6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:31.980537 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3896d850-1c3e-47cf-b105-492cc819ada6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:31.981016 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0bc27ed1-224c-429d-bc69-a491024d46c7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:31.982464 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0bc27ed1-224c-429d-bc69-a491024d46c7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:31.992256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bc27ed1-224c-429d-bc69-a491024d46c7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:31.993107 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bc27ed1-224c-429d-bc69-a491024d46c7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:31.994592 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bc27ed1-224c-429d-bc69-a491024d46c7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:31.995318 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bc27ed1-224c-429d-bc69-a491024d46c7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:31.998612 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3896d850-1c3e-47cf-b105-492cc819ada6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:31.999907 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3896d850-1c3e-47cf-b105-492cc819ada6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:32.002193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3896d850-1c3e-47cf-b105-492cc819ada6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:32.003264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3896d850-1c3e-47cf-b105-492cc819ada6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:32.037800 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:32.568330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0bc27ed1-224c-429d-bc69-a491024d46c7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:32.579520 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0bc27ed1-224c-429d-bc69-a491024d46c7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:32.582506 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0bc27ed1-224c-429d-bc69-a491024d46c7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:32.586576 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0bc27ed1-224c-429d-bc69-a491024d46c7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1750 microversion: 2.20 time: 0.610129 Jul 31 20:02:32.588088 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 209/419] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:31 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1750 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:32.616168 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3896d850-1c3e-47cf-b105-492cc819ada6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:32.624584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3896d850-1c3e-47cf-b105-492cc819ada6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.654624 Jul 31 20:02:32.625686 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 211/420] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:31 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:32.884637 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-99f070c5-827a-48dc-bb18-c8e9a551f4d8 req-01340c04-3f86-40e9-b5f3-772f1be332ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac54baf-9c5e-4774-be4a-78b89959104f", "name": "network-vif-plugged", "status": "completed", "tag": "4b015db4-1121-4b9d-8f46-45643ea431bf"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:32.905054 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-99f070c5-827a-48dc-bb18-c8e9a551f4d8 req-01340c04-3f86-40e9-b5f3-772f1be332ab service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:32.905754 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-99f070c5-827a-48dc-bb18-c8e9a551f4d8 req-01340c04-3f86-40e9-b5f3-772f1be332ab service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:32.919302 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-99f070c5-827a-48dc-bb18-c8e9a551f4d8 req-01340c04-3f86-40e9-b5f3-772f1be332ab service nova] Creating event network-vif-plugged:4b015db4-1121-4b9d-8f46-45643ea431bf for instance bac54baf-9c5e-4774-be4a-78b89959104f on hv-cinder-84984 Jul 31 20:02:32.936857 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-99f070c5-827a-48dc-bb18-c8e9a551f4d8 req-01340c04-3f86-40e9-b5f3-772f1be332ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055915 Jul 31 20:02:32.939003 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 210/421] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:02:33.614750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-33e334d2-4687-4827-b3fd-6afad93014dc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:33.616149 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-33e334d2-4687-4827-b3fd-6afad93014dc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:33.623697 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33e334d2-4687-4827-b3fd-6afad93014dc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:33.624393 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33e334d2-4687-4827-b3fd-6afad93014dc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:33.625363 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33e334d2-4687-4827-b3fd-6afad93014dc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:33.626163 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33e334d2-4687-4827-b3fd-6afad93014dc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:33.646842 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0128e5f7-52a3-4346-857d-a78ecf329b3d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:33.647540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0128e5f7-52a3-4346-857d-a78ecf329b3d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:33.659143 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0128e5f7-52a3-4346-857d-a78ecf329b3d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:33.661192 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0128e5f7-52a3-4346-857d-a78ecf329b3d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:33.664850 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0128e5f7-52a3-4346-857d-a78ecf329b3d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:33.665382 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0128e5f7-52a3-4346-857d-a78ecf329b3d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:33.891887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-33e334d2-4687-4827-b3fd-6afad93014dc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:33.909411 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-33e334d2-4687-4827-b3fd-6afad93014dc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:33.910825 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-33e334d2-4687-4827-b3fd-6afad93014dc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:33.911992 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-33e334d2-4687-4827-b3fd-6afad93014dc tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1750 microversion: 2.20 time: 0.301991 Jul 31 20:02:33.912719 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 212/422] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:33 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1750 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:33.935179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0128e5f7-52a3-4346-857d-a78ecf329b3d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:33.942809 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0128e5f7-52a3-4346-857d-a78ecf329b3d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.300953 Jul 31 20:02:33.943584 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 211/423] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:33 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:34.935811 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-540cabf5-fbc4-463b-86fa-a77ef121c2c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:34.936431 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-540cabf5-fbc4-463b-86fa-a77ef121c2c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:34.944423 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-540cabf5-fbc4-463b-86fa-a77ef121c2c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:34.945187 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-540cabf5-fbc4-463b-86fa-a77ef121c2c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:34.946172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-540cabf5-fbc4-463b-86fa-a77ef121c2c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:34.947182 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-540cabf5-fbc4-463b-86fa-a77ef121c2c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:34.964730 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1f654428-c0a0-4351-adb2-033e85cf1f88 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:34.965409 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1f654428-c0a0-4351-adb2-033e85cf1f88 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:34.977570 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f654428-c0a0-4351-adb2-033e85cf1f88 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:34.978299 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f654428-c0a0-4351-adb2-033e85cf1f88 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:34.993954 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f654428-c0a0-4351-adb2-033e85cf1f88 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:34.994986 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f654428-c0a0-4351-adb2-033e85cf1f88 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:35.341650 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-540cabf5-fbc4-463b-86fa-a77ef121c2c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:35.358952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-540cabf5-fbc4-463b-86fa-a77ef121c2c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:35.370131 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-540cabf5-fbc4-463b-86fa-a77ef121c2c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:35.373619 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-540cabf5-fbc4-463b-86fa-a77ef121c2c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1752 microversion: 2.20 time: 0.441254 Jul 31 20:02:35.375762 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 213/424] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:34 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1752 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:35.424008 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1f654428-c0a0-4351-adb2-033e85cf1f88 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:35.435531 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1f654428-c0a0-4351-adb2-033e85cf1f88 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1372 microversion: 2.1 time: 0.475233 Jul 31 20:02:35.437245 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 212/425] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:34 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1372 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:36.398734 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-64889a26-9106-4706-93fd-fd3c5ee5d2d7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:36.401017 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-64889a26-9106-4706-93fd-fd3c5ee5d2d7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:36.415023 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64889a26-9106-4706-93fd-fd3c5ee5d2d7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:36.415592 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64889a26-9106-4706-93fd-fd3c5ee5d2d7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:36.416494 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64889a26-9106-4706-93fd-fd3c5ee5d2d7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:36.417124 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64889a26-9106-4706-93fd-fd3c5ee5d2d7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:36.464412 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5e11856c-cf4f-4504-8a81-a0473fdd0b62 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:36.465316 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5e11856c-cf4f-4504-8a81-a0473fdd0b62 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:36.479918 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e11856c-cf4f-4504-8a81-a0473fdd0b62 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:36.480796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e11856c-cf4f-4504-8a81-a0473fdd0b62 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:36.482737 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e11856c-cf4f-4504-8a81-a0473fdd0b62 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:36.486492 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e11856c-cf4f-4504-8a81-a0473fdd0b62 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:36.734538 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-64889a26-9106-4706-93fd-fd3c5ee5d2d7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:36.747404 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-64889a26-9106-4706-93fd-fd3c5ee5d2d7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:36.751940 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5e11856c-cf4f-4504-8a81-a0473fdd0b62 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:36.762233 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5e11856c-cf4f-4504-8a81-a0473fdd0b62 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1567 microversion: 2.1 time: 0.303978 Jul 31 20:02:36.764675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 213/426] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:36 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:02:36.765032 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-64889a26-9106-4706-93fd-fd3c5ee5d2d7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:36.766613 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-64889a26-9106-4706-93fd-fd3c5ee5d2d7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1752 microversion: 2.20 time: 0.372261 Jul 31 20:02:36.767375 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 214/427] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:36 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1752 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:36.791171 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ea8ac3ef-8ccb-4d9b-b585-dadedccdef3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:36.791928 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ea8ac3ef-8ccb-4d9b-b585-dadedccdef3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:36.805050 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea8ac3ef-8ccb-4d9b-b585-dadedccdef3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:36.805826 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea8ac3ef-8ccb-4d9b-b585-dadedccdef3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:36.806823 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea8ac3ef-8ccb-4d9b-b585-dadedccdef3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:36.807435 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea8ac3ef-8ccb-4d9b-b585-dadedccdef3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:36.930001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ea8ac3ef-8ccb-4d9b-b585-dadedccdef3b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147707 Jul 31 20:02:36.931520 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 214/428] 10.222.0.48 () {58 vars in 1275 bytes} [Sun Jul 31 20:02:36 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:02:37.806229 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e830d9f-deff-4512-a617-e0f448f682a3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:37.807792 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7e830d9f-deff-4512-a617-e0f448f682a3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:37.830633 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e830d9f-deff-4512-a617-e0f448f682a3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:37.833052 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e830d9f-deff-4512-a617-e0f448f682a3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:37.834013 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e830d9f-deff-4512-a617-e0f448f682a3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:37.834547 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e830d9f-deff-4512-a617-e0f448f682a3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:38.782544 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7e830d9f-deff-4512-a617-e0f448f682a3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:38.806649 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7e830d9f-deff-4512-a617-e0f448f682a3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:38.809123 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7e830d9f-deff-4512-a617-e0f448f682a3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:38.810745 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7e830d9f-deff-4512-a617-e0f448f682a3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 1.023189 Jul 31 20:02:38.811495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 215/429] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:37 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:02:39.834338 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8ab7b1ae-1c7e-4990-bdf7-7b79900a5ae0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:39.835051 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8ab7b1ae-1c7e-4990-bdf7-7b79900a5ae0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:39.863729 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ab7b1ae-1c7e-4990-bdf7-7b79900a5ae0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:39.864285 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ab7b1ae-1c7e-4990-bdf7-7b79900a5ae0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:39.866232 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ab7b1ae-1c7e-4990-bdf7-7b79900a5ae0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:39.867489 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ab7b1ae-1c7e-4990-bdf7-7b79900a5ae0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:40.187541 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-0d1e8c6a-d3cd-4955-9b9b-aa3d0b503b48 req-44b3d605-97d8-481e-adfd-f933f2ca196c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac54baf-9c5e-4774-be4a-78b89959104f", "tag": "4b015db4-1121-4b9d-8f46-45643ea431bf"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:40.209450 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0d1e8c6a-d3cd-4955-9b9b-aa3d0b503b48 req-44b3d605-97d8-481e-adfd-f933f2ca196c service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:40.209888 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0d1e8c6a-d3cd-4955-9b9b-aa3d0b503b48 req-44b3d605-97d8-481e-adfd-f933f2ca196c service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:40.234327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-0d1e8c6a-d3cd-4955-9b9b-aa3d0b503b48 req-44b3d605-97d8-481e-adfd-f933f2ca196c service nova] Creating event network-changed:4b015db4-1121-4b9d-8f46-45643ea431bf for instance bac54baf-9c5e-4774-be4a-78b89959104f on hv-cinder-84984 Jul 31 20:02:40.255960 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-0d1e8c6a-d3cd-4955-9b9b-aa3d0b503b48 req-44b3d605-97d8-481e-adfd-f933f2ca196c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072308 Jul 31 20:02:40.265934 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 216/430] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:02:40.334118 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8ab7b1ae-1c7e-4990-bdf7-7b79900a5ae0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:40.392665 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8ab7b1ae-1c7e-4990-bdf7-7b79900a5ae0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:40.417296 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8ab7b1ae-1c7e-4990-bdf7-7b79900a5ae0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:40.419415 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8ab7b1ae-1c7e-4990-bdf7-7b79900a5ae0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.589796 Jul 31 20:02:40.420249 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 215/431] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:39 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:41.448206 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0c27a0ae-0392-4cba-879b-8ffec2bc7cb3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:41.448902 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0c27a0ae-0392-4cba-879b-8ffec2bc7cb3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:41.483408 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c27a0ae-0392-4cba-879b-8ffec2bc7cb3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:41.483848 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c27a0ae-0392-4cba-879b-8ffec2bc7cb3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:41.484631 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c27a0ae-0392-4cba-879b-8ffec2bc7cb3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:41.485054 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c27a0ae-0392-4cba-879b-8ffec2bc7cb3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:42.058833 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c27a0ae-0392-4cba-879b-8ffec2bc7cb3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:42.083155 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c27a0ae-0392-4cba-879b-8ffec2bc7cb3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:42.088474 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c27a0ae-0392-4cba-879b-8ffec2bc7cb3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:42.089726 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0c27a0ae-0392-4cba-879b-8ffec2bc7cb3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.649303 Jul 31 20:02:42.091002 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 217/432] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:41 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:43.117073 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d96a6c09-c64a-42b6-a614-bb5db4343604 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:43.118645 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d96a6c09-c64a-42b6-a614-bb5db4343604 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:43.133739 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d96a6c09-c64a-42b6-a614-bb5db4343604 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:43.142703 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d96a6c09-c64a-42b6-a614-bb5db4343604 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:43.143829 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d96a6c09-c64a-42b6-a614-bb5db4343604 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:43.144414 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d96a6c09-c64a-42b6-a614-bb5db4343604 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:43.418784 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d96a6c09-c64a-42b6-a614-bb5db4343604 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:43.431945 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d96a6c09-c64a-42b6-a614-bb5db4343604 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:43.440349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d96a6c09-c64a-42b6-a614-bb5db4343604 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:43.440349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d96a6c09-c64a-42b6-a614-bb5db4343604 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.325809 Jul 31 20:02:43.455819 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 216/433] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:43 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:44.464952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3ad5ae29-07e4-4597-b18a-f822566e181d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:44.466435 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3ad5ae29-07e4-4597-b18a-f822566e181d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:44.480028 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ad5ae29-07e4-4597-b18a-f822566e181d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:44.481238 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ad5ae29-07e4-4597-b18a-f822566e181d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:44.486042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ad5ae29-07e4-4597-b18a-f822566e181d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:44.488124 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ad5ae29-07e4-4597-b18a-f822566e181d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:45.420130 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3ad5ae29-07e4-4597-b18a-f822566e181d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:45.432274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3ad5ae29-07e4-4597-b18a-f822566e181d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:45.443930 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3ad5ae29-07e4-4597-b18a-f822566e181d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:45.453932 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3ad5ae29-07e4-4597-b18a-f822566e181d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.993920 Jul 31 20:02:45.457796 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 218/434] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:44 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:46.483195 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-81d1f388-fac4-4746-99aa-41605c2b9312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:46.486266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-81d1f388-fac4-4746-99aa-41605c2b9312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:46.531724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-81d1f388-fac4-4746-99aa-41605c2b9312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:46.532169 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-81d1f388-fac4-4746-99aa-41605c2b9312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:46.541938 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-81d1f388-fac4-4746-99aa-41605c2b9312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:46.542416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-81d1f388-fac4-4746-99aa-41605c2b9312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:47.914867 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-81d1f388-fac4-4746-99aa-41605c2b9312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:47.928173 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-81d1f388-fac4-4746-99aa-41605c2b9312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:47.929768 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-81d1f388-fac4-4746-99aa-41605c2b9312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:47.930978 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-81d1f388-fac4-4746-99aa-41605c2b9312 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 1.452572 Jul 31 20:02:47.955289 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 217/435] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:46 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:48.957976 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-751c70a0-2b6a-4549-92a8-38e5828ad5e2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:48.959669 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-751c70a0-2b6a-4549-92a8-38e5828ad5e2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:48.964352 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=52 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:48.986765 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-751c70a0-2b6a-4549-92a8-38e5828ad5e2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:48.989326 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-751c70a0-2b6a-4549-92a8-38e5828ad5e2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:48.994915 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-751c70a0-2b6a-4549-92a8-38e5828ad5e2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:48.998167 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-751c70a0-2b6a-4549-92a8-38e5828ad5e2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:49.366437 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-751c70a0-2b6a-4549-92a8-38e5828ad5e2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:49.385531 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-751c70a0-2b6a-4549-92a8-38e5828ad5e2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:49.388674 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-751c70a0-2b6a-4549-92a8-38e5828ad5e2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:49.390618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-751c70a0-2b6a-4549-92a8-38e5828ad5e2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.438985 Jul 31 20:02:49.405185 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 219/436] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:48 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:50.255206 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-720cfd35-19e6-45a4-a41d-4f4ce350131e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Action: 'create', calling method: .version_select at 0x7ffa247fc5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-636428792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBER7AKCiwY3mFGTvzfD+vg9ZpvDtADYe6hDfxWvPR1AXlK80RI/FkCA/CwUol7kW6hGrjquAPksFnqi1l40Mr1NPyj4ni22qkk4S5ATuLCS0uoY3sZzNisEqxqElVdcXYQ=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:50.268176 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:50.294187 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-720cfd35-19e6-45a4-a41d-4f4ce350131e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Getting quotas for project a25221a81c1e49fbacdde74417e9a9c5. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:02:50.316481 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-720cfd35-19e6-45a4-a41d-4f4ce350131e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Getting quotas for user 80d3808785b345978fbe2e28a49e9f79 and project a25221a81c1e49fbacdde74417e9a9c5. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:02:50.354281 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR oslo.messaging._drivers.impl_rabbit [None req-720cfd35-19e6-45a4-a41d-4f4ce350131e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [48bdfd52-293c-42fc-8257-0a5f6993ced2] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 31 20:02:50.419163 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f4f294c8-babd-4297-beee-c648ceac6d56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:50.420497 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f4f294c8-babd-4297-beee-c648ceac6d56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:50.428849 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f4f294c8-babd-4297-beee-c648ceac6d56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:50.429313 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f4f294c8-babd-4297-beee-c648ceac6d56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:50.430265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f4f294c8-babd-4297-beee-c648ceac6d56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:50.430853 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f4f294c8-babd-4297-beee-c648ceac6d56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:50.636681 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f4f294c8-babd-4297-beee-c648ceac6d56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:50.651840 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f4f294c8-babd-4297-beee-c648ceac6d56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:50.653573 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f4f294c8-babd-4297-beee-c648ceac6d56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:50.654996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f4f294c8-babd-4297-beee-c648ceac6d56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.240896 Jul 31 20:02:50.656299 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 220/437] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:50 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:51.365050 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [None req-720cfd35-19e6-45a4-a41d-4f4ce350131e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [48bdfd52-293c-42fc-8257-0a5f6993ced2] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 36774. Jul 31 20:02:51.399076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-720cfd35-19e6-45a4-a41d-4f4ce350131e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.148428 Jul 31 20:02:51.400101 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 218/438] 10.222.0.48 () {60 vars in 1159 bytes} [Sun Jul 31 20:02:50 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:02:51.585601 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1885418447", "imageRef": "91e3313d-387a-457e-99ee-b657ace24905", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-636428792", "networks": [{"uuid": "bb115f08-ac59-4002-aab6-ff45b48b747e"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:51.680057 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-aaf61e3b-f887-43d4-bc5d-05ebe51774ff tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:51.680963 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-aaf61e3b-f887-43d4-bc5d-05ebe51774ff tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:51.689910 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aaf61e3b-f887-43d4-bc5d-05ebe51774ff tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:51.690570 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aaf61e3b-f887-43d4-bc5d-05ebe51774ff tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:51.691509 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aaf61e3b-f887-43d4-bc5d-05ebe51774ff tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:51.692332 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aaf61e3b-f887-43d4-bc5d-05ebe51774ff tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:51.705994 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] validate_networks() for [('bb115f08-ac59-4002-aab6-ff45b48b747e', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:02:52.102935 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-aaf61e3b-f887-43d4-bc5d-05ebe51774ff tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:52.112267 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-aaf61e3b-f887-43d4-bc5d-05ebe51774ff tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:52.113845 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-aaf61e3b-f887-43d4-bc5d-05ebe51774ff tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:52.115008 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-aaf61e3b-f887-43d4-bc5d-05ebe51774ff tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.440828 Jul 31 20:02:52.115571 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 219/439] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:51 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:52.337060 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-edb11782-76b8-4ba2-909c-e1f4ab1423a2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Action: 'create', calling method: .version_select at 0x7ffa24ba4ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1722570919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC86OZY/NcjiASZP1CvmMYoSquxPXFRArCbnAL/PqUQhlxvkxQ4vCDXfLcHnRXmqvnD1sFJN5LHq+PJ6uIL6BAHZhdoQsK55u0dOotAfNOQMDhtowwoQuJBJVYuBZBWiSw=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:52.353684 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-edb11782-76b8-4ba2-909c-e1f4ab1423a2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Getting quotas for project d5a9021b3b804f58a2a4e73676bfc480. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:02:52.359199 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-edb11782-76b8-4ba2-909c-e1f4ab1423a2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Getting quotas for user 73f54d49acf0427e843caddf99e66277 and project d5a9021b3b804f58a2a4e73676bfc480. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:02:52.377586 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:02:52.378349 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:02:52.378804 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:02:52.379220 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:02:52.379646 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:02:52.386942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-edb11782-76b8-4ba2-909c-e1f4ab1423a2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.270338 Jul 31 20:02:52.387606 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 220/440] 10.222.0.48 () {60 vars in 1159 bytes} [Sun Jul 31 20:02:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:02:52.389949 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:52.390386 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:52.391164 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:52.391584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:52.409040 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Getting quotas for project a25221a81c1e49fbacdde74417e9a9c5. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:02:52.412914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Getting quotas for user 80d3808785b345978fbe2e28a49e9f79 and project a25221a81c1e49fbacdde74417e9a9c5. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:02:52.424821 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:02:52.427107 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91e3313d-387a-457e-99ee-b657ace24905',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:02:52.481056 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ce246cb9-024c-471d-8793-2c9c6e715392 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899588 Jul 31 20:02:52.483349 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 221/441] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:02:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:02:52.494529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7f7dd71d-c70f-4bf8-b39a-177312d40194 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:52.498089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7f7dd71d-c70f-4bf8-b39a-177312d40194 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:52.593220 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7f7dd71d-c70f-4bf8-b39a-177312d40194 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:52.600442 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7f7dd71d-c70f-4bf8-b39a-177312d40194 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1258 microversion: 2.1 time: 0.110210 Jul 31 20:02:52.601169 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 221/442] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:52 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1258 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:53.139473 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-17505013-03de-4604-bf88-53bb3762997b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:53.140815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-17505013-03de-4604-bf88-53bb3762997b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:53.151830 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17505013-03de-4604-bf88-53bb3762997b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:53.152270 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17505013-03de-4604-bf88-53bb3762997b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:53.153053 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17505013-03de-4604-bf88-53bb3762997b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:53.153635 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17505013-03de-4604-bf88-53bb3762997b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:53.393633 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-17505013-03de-4604-bf88-53bb3762997b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:53.407659 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-17505013-03de-4604-bf88-53bb3762997b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:53.409334 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-17505013-03de-4604-bf88-53bb3762997b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:53.410807 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-17505013-03de-4604-bf88-53bb3762997b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.276182 Jul 31 20:02:53.412002 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 222/443] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:53 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:53.627319 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a2cd827a-918b-4574-a13b-06db2cd5e67a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:53.627860 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a2cd827a-918b-4574-a13b-06db2cd5e67a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:53.634969 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2cd827a-918b-4574-a13b-06db2cd5e67a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:53.635750 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2cd827a-918b-4574-a13b-06db2cd5e67a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:53.636944 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2cd827a-918b-4574-a13b-06db2cd5e67a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:53.637560 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2cd827a-918b-4574-a13b-06db2cd5e67a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:53.751449 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a2cd827a-918b-4574-a13b-06db2cd5e67a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:53.759322 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a2cd827a-918b-4574-a13b-06db2cd5e67a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1262 microversion: 2.1 time: 0.140992 Jul 31 20:02:53.770381 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 222/444] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:53 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1262 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:54.436550 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9cfc3c1e-a050-4084-b653-0e16dfc326cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:54.437198 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9cfc3c1e-a050-4084-b653-0e16dfc326cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:54.443806 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cfc3c1e-a050-4084-b653-0e16dfc326cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:54.444250 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cfc3c1e-a050-4084-b653-0e16dfc326cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:54.445022 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cfc3c1e-a050-4084-b653-0e16dfc326cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:54.445486 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cfc3c1e-a050-4084-b653-0e16dfc326cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:54.448316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:54.624551 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9cfc3c1e-a050-4084-b653-0e16dfc326cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:54.633749 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9cfc3c1e-a050-4084-b653-0e16dfc326cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:54.635156 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9cfc3c1e-a050-4084-b653-0e16dfc326cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:54.636321 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9cfc3c1e-a050-4084-b653-0e16dfc326cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.204244 Jul 31 20:02:54.637045 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 223/445] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:54 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:54.784407 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3b1c4a2b-f314-4a0c-a769-e6982d195bae tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:54.785194 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3b1c4a2b-f314-4a0c-a769-e6982d195bae tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:54.794499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b1c4a2b-f314-4a0c-a769-e6982d195bae tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:54.794946 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b1c4a2b-f314-4a0c-a769-e6982d195bae tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:54.795723 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b1c4a2b-f314-4a0c-a769-e6982d195bae tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:54.796156 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b1c4a2b-f314-4a0c-a769-e6982d195bae tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:54.881879 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3b1c4a2b-f314-4a0c-a769-e6982d195bae tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:54.890236 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3b1c4a2b-f314-4a0c-a769-e6982d195bae tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1262 microversion: 2.1 time: 0.111376 Jul 31 20:02:54.891521 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 223/446] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:54 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1262 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:55.661240 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6808b8c5-f110-47e9-bbb5-54ea537b982d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:55.661861 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6808b8c5-f110-47e9-bbb5-54ea537b982d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:55.668311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6808b8c5-f110-47e9-bbb5-54ea537b982d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:55.668745 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6808b8c5-f110-47e9-bbb5-54ea537b982d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:55.669555 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6808b8c5-f110-47e9-bbb5-54ea537b982d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:55.669983 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6808b8c5-f110-47e9-bbb5-54ea537b982d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:55.864528 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6808b8c5-f110-47e9-bbb5-54ea537b982d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:55.874633 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6808b8c5-f110-47e9-bbb5-54ea537b982d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:55.877357 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6808b8c5-f110-47e9-bbb5-54ea537b982d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:55.878560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6808b8c5-f110-47e9-bbb5-54ea537b982d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.222395 Jul 31 20:02:55.879439 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 224/447] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:55 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:55.911623 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9244cfd5-3b53-4e7e-8d38-47fa278c685d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:55.917323 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9244cfd5-3b53-4e7e-8d38-47fa278c685d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:55.929039 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9244cfd5-3b53-4e7e-8d38-47fa278c685d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:55.932507 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9244cfd5-3b53-4e7e-8d38-47fa278c685d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:55.933412 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9244cfd5-3b53-4e7e-8d38-47fa278c685d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:55.934038 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9244cfd5-3b53-4e7e-8d38-47fa278c685d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:55.953826 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-289ad5d0-9db5-4e4a-abc1-9cdbf420375c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:55.954311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-289ad5d0-9db5-4e4a-abc1-9cdbf420375c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:55.960787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-289ad5d0-9db5-4e4a-abc1-9cdbf420375c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:55.961542 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-289ad5d0-9db5-4e4a-abc1-9cdbf420375c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:55.962451 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-289ad5d0-9db5-4e4a-abc1-9cdbf420375c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:55.963017 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-289ad5d0-9db5-4e4a-abc1-9cdbf420375c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:55.997533 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-289ad5d0-9db5-4e4a-abc1-9cdbf420375c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d/ips" status: 200 len: 149 microversion: 2.1 time: 0.047251 Jul 31 20:02:56.011263 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9244cfd5-3b53-4e7e-8d38-47fa278c685d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:56.018220 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 225/448] 10.222.0.48 () {58 vars in 1248 bytes} [Sun Jul 31 20:02:55 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d/ips => generated 149 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:02:56.022757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9244cfd5-3b53-4e7e-8d38-47fa278c685d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1262 microversion: 2.1 time: 0.115039 Jul 31 20:02:56.025492 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 224/449] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:55 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1262 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:56.041494 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3497dd30-15e7-46b7-a391-516399465325 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f71fa441-f59a-4baa-a29c-715824bb83cb"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:02:56.044092 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3497dd30-15e7-46b7-a391-516399465325 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:56.050243 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3497dd30-15e7-46b7-a391-516399465325 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:56.050681 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3497dd30-15e7-46b7-a391-516399465325 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:56.051471 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3497dd30-15e7-46b7-a391-516399465325 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:56.052217 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3497dd30-15e7-46b7-a391-516399465325 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:56.205578 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-3497dd30-15e7-46b7-a391-516399465325 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Invalid volume: volume f71fa441-f59a-4baa-a29c-715824bb83cb is already attached to instances: 176aa7ed-3c42-4749-852d-a397673e4e57 Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3497dd30-15e7-46b7-a391-516399465325 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d/os-volume_attachments HTTP/1.1 Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 74 Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:02:56.207311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:02:56.208694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:02:56.208694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:02:56.208694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:02:56.208694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:02:56.208694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:02:56.208694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:02:56.208694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:02:56.208694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:02:56.208694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:02:56.208694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Jul 31 20:02:56.208694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {"volumeAttachment": {"volumeId": "f71fa441-f59a-4baa-a29c-715824bb83cb"}} Jul 31 20:02:56.208694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Invalid volume: volume f71fa441-f59a-4baa-a29c-715824bb83cb is already attached to instances: 176aa7ed-3c42-4749-852d-a397673e4e57 Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'server_id': 'feed8b88-8df9-44a5-9520-0d723924fd1d', 'body': {'volumeAttachment': {'volumeId': 'f71fa441-f59a-4baa-a29c-715824bb83cb'}}} Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f71fa441-f59a-4baa-a29c-715824bb83cb is already attached to instances: 176aa7ed-3c42-4749-852d-a397673e4e57 Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:02:56.209490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f71fa441-f59a-4baa-a29c-715824bb83cb is already attached to instances: 176aa7ed-3c42-4749-852d-a397673e4e57 Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:02:56.210692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:02:56.211860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:02:56.211860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:02:56.211860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:02:56.211860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f71fa441-f59a-4baa-a29c-715824bb83cb is already attached to instances: 176aa7ed-3c42-4749-852d-a397673e4e57 Jul 31 20:02:56.211860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:02:56.211860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3497dd30-15e7-46b7-a391-516399465325 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 400 to user: Invalid volume: volume f71fa441-f59a-4baa-a29c-715824bb83cb is already attached to instances: 176aa7ed-3c42-4749-852d-a397673e4e57 {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:02:56.211860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3497dd30-15e7-46b7-a391-516399465325 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "POST /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.189113 Jul 31 20:02:56.211860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 226/450] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:02:56 2022] POST /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d/os-volume_attachments => generated 174 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 20:02:56.221144 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-906b4cac-b2db-4976-960d-b28bb4a72b9c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:56.221690 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-906b4cac-b2db-4976-960d-b28bb4a72b9c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:56.227985 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-906b4cac-b2db-4976-960d-b28bb4a72b9c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:56.228430 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-906b4cac-b2db-4976-960d-b28bb4a72b9c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:56.229256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-906b4cac-b2db-4976-960d-b28bb4a72b9c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:56.229671 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-906b4cac-b2db-4976-960d-b28bb4a72b9c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:56.264538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-906b4cac-b2db-4976-960d-b28bb4a72b9c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:02:56.399138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-906b4cac-b2db-4976-960d-b28bb4a72b9c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 204 len: 0 microversion: 2.1 time: 0.181553 Jul 31 20:02:56.403032 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 225/451] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:02:56 2022] DELETE /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:02:56.408983 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7043b44f-b75a-486e-8380-36791dd93e23 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:56.409744 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7043b44f-b75a-486e-8380-36791dd93e23 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:56.417576 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7043b44f-b75a-486e-8380-36791dd93e23 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:56.418316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7043b44f-b75a-486e-8380-36791dd93e23 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:56.419287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7043b44f-b75a-486e-8380-36791dd93e23 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:56.419955 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7043b44f-b75a-486e-8380-36791dd93e23 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:56.590648 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7043b44f-b75a-486e-8380-36791dd93e23 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:56.600099 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7043b44f-b75a-486e-8380-36791dd93e23 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1682 microversion: 2.1 time: 0.195425 Jul 31 20:02:56.601460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 227/452] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:56 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:56.904117 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-138e84cd-9006-4dc0-9dc8-3fd6b9b88be7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:56.904822 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-138e84cd-9006-4dc0-9dc8-3fd6b9b88be7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:56.911280 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-138e84cd-9006-4dc0-9dc8-3fd6b9b88be7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:56.911814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-138e84cd-9006-4dc0-9dc8-3fd6b9b88be7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:56.912828 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-138e84cd-9006-4dc0-9dc8-3fd6b9b88be7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:56.913499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-138e84cd-9006-4dc0-9dc8-3fd6b9b88be7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:57.046896 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a27ba539-cb2f-4a53-86d5-52a46ca1073a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:57.047508 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a27ba539-cb2f-4a53-86d5-52a46ca1073a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:57.054449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a27ba539-cb2f-4a53-86d5-52a46ca1073a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:57.055305 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a27ba539-cb2f-4a53-86d5-52a46ca1073a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:57.056240 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a27ba539-cb2f-4a53-86d5-52a46ca1073a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:57.056984 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a27ba539-cb2f-4a53-86d5-52a46ca1073a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:57.137600 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a27ba539-cb2f-4a53-86d5-52a46ca1073a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:57.141210 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-138e84cd-9006-4dc0-9dc8-3fd6b9b88be7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:57.152551 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-138e84cd-9006-4dc0-9dc8-3fd6b9b88be7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:57.152858 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a27ba539-cb2f-4a53-86d5-52a46ca1073a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1262 microversion: 2.1 time: 0.109982 Jul 31 20:02:57.154418 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 228/453] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:57 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1262 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:57.155240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-138e84cd-9006-4dc0-9dc8-3fd6b9b88be7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:57.156569 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-138e84cd-9006-4dc0-9dc8-3fd6b9b88be7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.257298 Jul 31 20:02:57.157437 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 226/454] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:56 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:57.622296 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0c9319fd-6a4c-41fe-81c7-035c2fcd9d81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:57.623004 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0c9319fd-6a4c-41fe-81c7-035c2fcd9d81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:57.630497 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c9319fd-6a4c-41fe-81c7-035c2fcd9d81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:57.630945 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c9319fd-6a4c-41fe-81c7-035c2fcd9d81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:57.631727 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c9319fd-6a4c-41fe-81c7-035c2fcd9d81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:57.632162 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c9319fd-6a4c-41fe-81c7-035c2fcd9d81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:57.777316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c9319fd-6a4c-41fe-81c7-035c2fcd9d81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:57.786025 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0c9319fd-6a4c-41fe-81c7-035c2fcd9d81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1682 microversion: 2.1 time: 0.167982 Jul 31 20:02:57.787193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 229/455] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:57 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:58.184087 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4e3b06b9-7bf2-434e-beff-96cab2e66964 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:58.184752 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4e3b06b9-7bf2-434e-beff-96cab2e66964 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:58.189344 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f347139f-850e-4608-9004-a4443b2f9840 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:58.189869 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f347139f-850e-4608-9004-a4443b2f9840 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:58.191755 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4e3b06b9-7bf2-434e-beff-96cab2e66964 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:58.192182 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4e3b06b9-7bf2-434e-beff-96cab2e66964 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:58.193001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4e3b06b9-7bf2-434e-beff-96cab2e66964 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:58.193458 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4e3b06b9-7bf2-434e-beff-96cab2e66964 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:58.196130 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f347139f-850e-4608-9004-a4443b2f9840 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:58.196578 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f347139f-850e-4608-9004-a4443b2f9840 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:58.197364 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f347139f-850e-4608-9004-a4443b2f9840 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:58.197796 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f347139f-850e-4608-9004-a4443b2f9840 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:58.287881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f347139f-850e-4608-9004-a4443b2f9840 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:58.299238 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f347139f-850e-4608-9004-a4443b2f9840 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1262 microversion: 2.1 time: 0.113663 Jul 31 20:02:58.300355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 230/456] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:58 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1262 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:58.366064 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4e3b06b9-7bf2-434e-beff-96cab2e66964 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:58.376626 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4e3b06b9-7bf2-434e-beff-96cab2e66964 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:58.378282 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4e3b06b9-7bf2-434e-beff-96cab2e66964 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:58.379445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4e3b06b9-7bf2-434e-beff-96cab2e66964 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.199410 Jul 31 20:02:58.380004 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 227/457] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:58 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:58.808591 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ffc1e445-68d4-49c1-ac17-0fbf57ed07bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:58.809180 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ffc1e445-68d4-49c1-ac17-0fbf57ed07bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:58.815685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffc1e445-68d4-49c1-ac17-0fbf57ed07bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:58.816122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffc1e445-68d4-49c1-ac17-0fbf57ed07bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:58.816873 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffc1e445-68d4-49c1-ac17-0fbf57ed07bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:58.817338 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffc1e445-68d4-49c1-ac17-0fbf57ed07bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:58.955710 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffc1e445-68d4-49c1-ac17-0fbf57ed07bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:58.963720 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ffc1e445-68d4-49c1-ac17-0fbf57ed07bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1682 microversion: 2.1 time: 0.159121 Jul 31 20:02:58.964284 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 231/458] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:58 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:59.325116 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5f713a6c-f71b-459f-942b-695b82429dc6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:59.325748 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5f713a6c-f71b-459f-942b-695b82429dc6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:59.332761 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f713a6c-f71b-459f-942b-695b82429dc6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:59.333243 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f713a6c-f71b-459f-942b-695b82429dc6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:59.334007 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f713a6c-f71b-459f-942b-695b82429dc6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:59.334436 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f713a6c-f71b-459f-942b-695b82429dc6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:59.352616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:02:59.402700 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5f713a6c-f71b-459f-942b-695b82429dc6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:59.403221 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9517660c-79ee-4428-88ed-b06968e09e74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:59.404341 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9517660c-79ee-4428-88ed-b06968e09e74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:59.410385 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5f713a6c-f71b-459f-942b-695b82429dc6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1254 microversion: 2.1 time: 0.090302 Jul 31 20:02:59.410528 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9517660c-79ee-4428-88ed-b06968e09e74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:59.411004 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9517660c-79ee-4428-88ed-b06968e09e74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:59.411145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 228/459] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:59 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1254 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:02:59.411743 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9517660c-79ee-4428-88ed-b06968e09e74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:59.412179 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9517660c-79ee-4428-88ed-b06968e09e74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:59.544745 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9517660c-79ee-4428-88ed-b06968e09e74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:59.553314 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9517660c-79ee-4428-88ed-b06968e09e74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:59.554768 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9517660c-79ee-4428-88ed-b06968e09e74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:02:59.555911 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9517660c-79ee-4428-88ed-b06968e09e74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.156832 Jul 31 20:02:59.556610 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 232/460] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:02:59 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:02:59.985505 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f2638069-d70f-477b-8fd4-bbbc1e97d417 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:02:59.986008 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f2638069-d70f-477b-8fd4-bbbc1e97d417 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:02:59.992548 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f2638069-d70f-477b-8fd4-bbbc1e97d417 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:59.992966 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f2638069-d70f-477b-8fd4-bbbc1e97d417 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:02:59.993761 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f2638069-d70f-477b-8fd4-bbbc1e97d417 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:02:59.994553 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f2638069-d70f-477b-8fd4-bbbc1e97d417 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:00.134548 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f2638069-d70f-477b-8fd4-bbbc1e97d417 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:00.144255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f2638069-d70f-477b-8fd4-bbbc1e97d417 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1682 microversion: 2.1 time: 0.162610 Jul 31 20:03:00.145005 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 229/461] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:02:59 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:00.432244 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02a4de17-c969-4494-9419-d197462ad270 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:00.432986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-02a4de17-c969-4494-9419-d197462ad270 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:00.439722 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02a4de17-c969-4494-9419-d197462ad270 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:00.440240 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02a4de17-c969-4494-9419-d197462ad270 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:00.441503 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02a4de17-c969-4494-9419-d197462ad270 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:00.441996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02a4de17-c969-4494-9419-d197462ad270 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:00.506304 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02a4de17-c969-4494-9419-d197462ad270 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:00.514080 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-02a4de17-c969-4494-9419-d197462ad270 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1254 microversion: 2.1 time: 0.085836 Jul 31 20:03:00.514665 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 233/462] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:00 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1254 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:00.579128 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-60c41b61-1db9-4728-b6e8-577db9efebd7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:00.579734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-60c41b61-1db9-4728-b6e8-577db9efebd7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:00.586354 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60c41b61-1db9-4728-b6e8-577db9efebd7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:00.586798 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60c41b61-1db9-4728-b6e8-577db9efebd7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:00.587552 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60c41b61-1db9-4728-b6e8-577db9efebd7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:00.587990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60c41b61-1db9-4728-b6e8-577db9efebd7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:00.731840 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-60c41b61-1db9-4728-b6e8-577db9efebd7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:00.740625 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-60c41b61-1db9-4728-b6e8-577db9efebd7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:00.742285 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-60c41b61-1db9-4728-b6e8-577db9efebd7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:00.743468 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-60c41b61-1db9-4728-b6e8-577db9efebd7 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.168344 Jul 31 20:03:00.744003 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 230/463] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:00 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:01.166046 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c908bbe0-633e-4b34-919a-e55ab3a4cf6c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:01.166713 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c908bbe0-633e-4b34-919a-e55ab3a4cf6c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:01.173384 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c908bbe0-633e-4b34-919a-e55ab3a4cf6c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:01.173822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c908bbe0-633e-4b34-919a-e55ab3a4cf6c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:01.174575 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c908bbe0-633e-4b34-919a-e55ab3a4cf6c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:01.175000 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c908bbe0-633e-4b34-919a-e55ab3a4cf6c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:01.435598 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c908bbe0-633e-4b34-919a-e55ab3a4cf6c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:01.443469 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c908bbe0-633e-4b34-919a-e55ab3a4cf6c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1682 microversion: 2.1 time: 0.281741 Jul 31 20:03:01.444068 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 234/464] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:01 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1682 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:01.535223 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3b44a2dc-b489-4720-8841-54e6671c627d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:01.536083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3b44a2dc-b489-4720-8841-54e6671c627d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:01.544770 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b44a2dc-b489-4720-8841-54e6671c627d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:01.545361 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b44a2dc-b489-4720-8841-54e6671c627d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:01.546514 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b44a2dc-b489-4720-8841-54e6671c627d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:01.547481 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b44a2dc-b489-4720-8841-54e6671c627d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:01.680939 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3b44a2dc-b489-4720-8841-54e6671c627d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:01.689246 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3b44a2dc-b489-4720-8841-54e6671c627d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1328 microversion: 2.1 time: 0.157748 Jul 31 20:03:01.689747 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 231/465] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:01 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1328 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:01.768006 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fb2cb093-218f-4c4f-a982-200785f04eae tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:01.768606 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fb2cb093-218f-4c4f-a982-200785f04eae tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:01.779273 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb2cb093-218f-4c4f-a982-200785f04eae tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:01.780018 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb2cb093-218f-4c4f-a982-200785f04eae tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:01.780951 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb2cb093-218f-4c4f-a982-200785f04eae tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:01.781554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb2cb093-218f-4c4f-a982-200785f04eae tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:02.056128 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fb2cb093-218f-4c4f-a982-200785f04eae tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:02.066830 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fb2cb093-218f-4c4f-a982-200785f04eae tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:02.069002 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fb2cb093-218f-4c4f-a982-200785f04eae tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:02.070998 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fb2cb093-218f-4c4f-a982-200785f04eae tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.307279 Jul 31 20:03:02.089411 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 235/466] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:01 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:02.466296 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-41ddb255-8662-47c3-8e56-285ec5a66e19 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:02.467023 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-41ddb255-8662-47c3-8e56-285ec5a66e19 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:02.478793 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-41ddb255-8662-47c3-8e56-285ec5a66e19 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:02.479339 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-41ddb255-8662-47c3-8e56-285ec5a66e19 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:02.480185 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-41ddb255-8662-47c3-8e56-285ec5a66e19 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:02.480817 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-41ddb255-8662-47c3-8e56-285ec5a66e19 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:02.608878 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=10 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:02.711601 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-86e6253e-49f6-40e2-9faa-989d8ae66f86 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:02.712656 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-86e6253e-49f6-40e2-9faa-989d8ae66f86 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:02.723662 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:02.724575 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:02.727327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86e6253e-49f6-40e2-9faa-989d8ae66f86 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:02.729782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86e6253e-49f6-40e2-9faa-989d8ae66f86 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:02.730890 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86e6253e-49f6-40e2-9faa-989d8ae66f86 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:02.732644 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86e6253e-49f6-40e2-9faa-989d8ae66f86 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:02.775345 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-41ddb255-8662-47c3-8e56-285ec5a66e19 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:02.784451 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-41ddb255-8662-47c3-8e56-285ec5a66e19 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1614 microversion: 2.1 time: 0.322014 Jul 31 20:03:02.790452 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 232/467] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:02 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1614 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:02.808792 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-8ea8e8fd-79b8-45e3-9229-f44428bd4f3d req-99ab2477-e270-4f10-a2d9-512df08579b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feed8b88-8df9-44a5-9520-0d723924fd1d", "name": "network-vif-deleted", "tag": "d1dea7a4-f82d-4a04-9a13-0e5ac255e8b3"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:02.818984 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-8ea8e8fd-79b8-45e3-9229-f44428bd4f3d req-99ab2477-e270-4f10-a2d9-512df08579b1 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:02.824628 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-8ea8e8fd-79b8-45e3-9229-f44428bd4f3d req-99ab2477-e270-4f10-a2d9-512df08579b1 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:02.847276 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-8ea8e8fd-79b8-45e3-9229-f44428bd4f3d req-99ab2477-e270-4f10-a2d9-512df08579b1 service nova] Creating event network-vif-deleted:d1dea7a4-f82d-4a04-9a13-0e5ac255e8b3 for instance feed8b88-8df9-44a5-9520-0d723924fd1d on hv-cinder-84984 Jul 31 20:03:02.858162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-8ea8e8fd-79b8-45e3-9229-f44428bd4f3d req-99ab2477-e270-4f10-a2d9-512df08579b1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052846 Jul 31 20:03:02.865620 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 233/468] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:02.898093 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-86e6253e-49f6-40e2-9faa-989d8ae66f86 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:02.906741 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-86e6253e-49f6-40e2-9faa-989d8ae66f86 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1316 microversion: 2.1 time: 0.199800 Jul 31 20:03:02.907742 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 236/469] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:02 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:03:03.097743 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fc8bf02c-6dc2-4f4d-a7bc-17d8a670fd5f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:03.098552 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fc8bf02c-6dc2-4f4d-a7bc-17d8a670fd5f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:03.111570 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc8bf02c-6dc2-4f4d-a7bc-17d8a670fd5f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:03.112037 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc8bf02c-6dc2-4f4d-a7bc-17d8a670fd5f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:03.113173 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc8bf02c-6dc2-4f4d-a7bc-17d8a670fd5f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:03.115030 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc8bf02c-6dc2-4f4d-a7bc-17d8a670fd5f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:03.443224 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fc8bf02c-6dc2-4f4d-a7bc-17d8a670fd5f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:03.466012 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fc8bf02c-6dc2-4f4d-a7bc-17d8a670fd5f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:03.467541 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fc8bf02c-6dc2-4f4d-a7bc-17d8a670fd5f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:03.468723 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fc8bf02c-6dc2-4f4d-a7bc-17d8a670fd5f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.375546 Jul 31 20:03:03.469500 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 234/470] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:03 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:03.816369 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d0204b59-4600-44c6-846f-57a048083005 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:03.817903 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d0204b59-4600-44c6-846f-57a048083005 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:03.825960 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0204b59-4600-44c6-846f-57a048083005 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:03.826800 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0204b59-4600-44c6-846f-57a048083005 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:03.827851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0204b59-4600-44c6-846f-57a048083005 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:03.828507 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0204b59-4600-44c6-846f-57a048083005 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:03.932340 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d66b506c-3c65-43c5-adbd-874a4a8ded3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:03.933071 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d66b506c-3c65-43c5-adbd-874a4a8ded3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:03.933509 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d0204b59-4600-44c6-846f-57a048083005 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:03.944807 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d0204b59-4600-44c6-846f-57a048083005 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1614 microversion: 2.1 time: 0.133453 Jul 31 20:03:03.945466 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d66b506c-3c65-43c5-adbd-874a4a8ded3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:03.949208 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 237/471] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:03 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1614 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:03.950275 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d66b506c-3c65-43c5-adbd-874a4a8ded3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:03.951343 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d66b506c-3c65-43c5-adbd-874a4a8ded3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:03.952046 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d66b506c-3c65-43c5-adbd-874a4a8ded3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:04.141101 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d66b506c-3c65-43c5-adbd-874a4a8ded3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:04.158649 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d66b506c-3c65-43c5-adbd-874a4a8ded3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.230517 Jul 31 20:03:04.159312 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 235/472] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:03 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:04.492554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e74302c2-cd9f-4ea6-be16-e0140cabbcef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:04.493595 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e74302c2-cd9f-4ea6-be16-e0140cabbcef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:04.504092 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e74302c2-cd9f-4ea6-be16-e0140cabbcef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:04.508206 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e74302c2-cd9f-4ea6-be16-e0140cabbcef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:04.509279 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e74302c2-cd9f-4ea6-be16-e0140cabbcef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:04.509636 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e74302c2-cd9f-4ea6-be16-e0140cabbcef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:04.719934 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e74302c2-cd9f-4ea6-be16-e0140cabbcef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:04.729321 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e74302c2-cd9f-4ea6-be16-e0140cabbcef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:04.730813 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e74302c2-cd9f-4ea6-be16-e0140cabbcef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:04.732066 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e74302c2-cd9f-4ea6-be16-e0140cabbcef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.243973 Jul 31 20:03:04.732625 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 238/473] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:04 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:04.974400 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-85946293-fcd4-4c92-a851-08df840eca53 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:04.976243 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-85946293-fcd4-4c92-a851-08df840eca53 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:04.983986 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85946293-fcd4-4c92-a851-08df840eca53 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:04.984627 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85946293-fcd4-4c92-a851-08df840eca53 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:04.985457 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85946293-fcd4-4c92-a851-08df840eca53 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:04.986120 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85946293-fcd4-4c92-a851-08df840eca53 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:05.056212 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-85946293-fcd4-4c92-a851-08df840eca53 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:05.065102 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-85946293-fcd4-4c92-a851-08df840eca53 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1614 microversion: 2.1 time: 0.097511 Jul 31 20:03:05.066482 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 236/474] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:04 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1614 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:05.182613 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b944059d-98ab-4918-99e8-ee1a09513d0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:05.183239 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b944059d-98ab-4918-99e8-ee1a09513d0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:05.189674 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b944059d-98ab-4918-99e8-ee1a09513d0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:05.190112 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b944059d-98ab-4918-99e8-ee1a09513d0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:05.190880 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b944059d-98ab-4918-99e8-ee1a09513d0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:05.191297 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b944059d-98ab-4918-99e8-ee1a09513d0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:05.333390 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b944059d-98ab-4918-99e8-ee1a09513d0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:05.353094 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b944059d-98ab-4918-99e8-ee1a09513d0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.174430 Jul 31 20:03:05.361511 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 239/475] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:05 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:05.758217 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b6abfbc1-e1ad-41c7-b6f0-b92cb8c0e8ab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:05.759299 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b6abfbc1-e1ad-41c7-b6f0-b92cb8c0e8ab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:05.766321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6abfbc1-e1ad-41c7-b6f0-b92cb8c0e8ab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:05.767036 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6abfbc1-e1ad-41c7-b6f0-b92cb8c0e8ab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:05.768100 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6abfbc1-e1ad-41c7-b6f0-b92cb8c0e8ab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:05.768818 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6abfbc1-e1ad-41c7-b6f0-b92cb8c0e8ab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:05.932006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b6abfbc1-e1ad-41c7-b6f0-b92cb8c0e8ab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:05.941376 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b6abfbc1-e1ad-41c7-b6f0-b92cb8c0e8ab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:05.942871 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b6abfbc1-e1ad-41c7-b6f0-b92cb8c0e8ab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:05.944065 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b6abfbc1-e1ad-41c7-b6f0-b92cb8c0e8ab tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.189856 Jul 31 20:03:05.944577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 237/476] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:05 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:06.086569 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4c2b060e-aba2-4bf2-bb95-a42721f5b56c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:06.087160 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4c2b060e-aba2-4bf2-bb95-a42721f5b56c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:06.093344 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c2b060e-aba2-4bf2-bb95-a42721f5b56c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:06.093785 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c2b060e-aba2-4bf2-bb95-a42721f5b56c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:06.094530 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c2b060e-aba2-4bf2-bb95-a42721f5b56c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:06.094951 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c2b060e-aba2-4bf2-bb95-a42721f5b56c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:06.098794 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:06.164003 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4c2b060e-aba2-4bf2-bb95-a42721f5b56c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:06.172930 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4c2b060e-aba2-4bf2-bb95-a42721f5b56c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1614 microversion: 2.1 time: 0.090283 Jul 31 20:03:06.173572 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 240/477] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:06 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:06.376787 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2237bce2-7a5f-4937-acca-30a2854a09de tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:06.377658 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2237bce2-7a5f-4937-acca-30a2854a09de tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:06.386963 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2237bce2-7a5f-4937-acca-30a2854a09de tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:06.387692 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2237bce2-7a5f-4937-acca-30a2854a09de tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:06.388832 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2237bce2-7a5f-4937-acca-30a2854a09de tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:06.389529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2237bce2-7a5f-4937-acca-30a2854a09de tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:06.537582 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2237bce2-7a5f-4937-acca-30a2854a09de tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:06.549189 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2237bce2-7a5f-4937-acca-30a2854a09de tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.178093 Jul 31 20:03:06.549891 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 238/478] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:06 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:06.968193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3506f4cc-8b50-4356-a811-94fb1486a921 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:06.968801 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3506f4cc-8b50-4356-a811-94fb1486a921 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:06.988406 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3506f4cc-8b50-4356-a811-94fb1486a921 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:06.988406 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3506f4cc-8b50-4356-a811-94fb1486a921 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:06.988406 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3506f4cc-8b50-4356-a811-94fb1486a921 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:06.988406 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3506f4cc-8b50-4356-a811-94fb1486a921 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:07.136791 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3506f4cc-8b50-4356-a811-94fb1486a921 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:07.146306 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3506f4cc-8b50-4356-a811-94fb1486a921 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:07.147886 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3506f4cc-8b50-4356-a811-94fb1486a921 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:07.149221 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3506f4cc-8b50-4356-a811-94fb1486a921 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.184940 Jul 31 20:03:07.153190 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 241/479] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:06 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:03:07.194436 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-681952f1-6117-4786-b26f-9f2595dd974d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:07.195139 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-681952f1-6117-4786-b26f-9f2595dd974d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:07.201644 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-681952f1-6117-4786-b26f-9f2595dd974d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:07.202167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-681952f1-6117-4786-b26f-9f2595dd974d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:07.203007 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-681952f1-6117-4786-b26f-9f2595dd974d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:07.203488 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-681952f1-6117-4786-b26f-9f2595dd974d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:07.273848 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-681952f1-6117-4786-b26f-9f2595dd974d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:07.281382 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-681952f1-6117-4786-b26f-9f2595dd974d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1614 microversion: 2.1 time: 0.090981 Jul 31 20:03:07.281944 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 239/480] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:07 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:03:07.571327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8b4ff22f-d1a5-4027-a0df-8087b2ada2d9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:07.572184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8b4ff22f-d1a5-4027-a0df-8087b2ada2d9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:07.579782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b4ff22f-d1a5-4027-a0df-8087b2ada2d9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:07.580535 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b4ff22f-d1a5-4027-a0df-8087b2ada2d9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:07.580989 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b4ff22f-d1a5-4027-a0df-8087b2ada2d9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:07.582067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b4ff22f-d1a5-4027-a0df-8087b2ada2d9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:07.763387 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8b4ff22f-d1a5-4027-a0df-8087b2ada2d9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:07.772026 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8b4ff22f-d1a5-4027-a0df-8087b2ada2d9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.204685 Jul 31 20:03:07.772621 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 242/481] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:07 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:08.174681 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6ce8b3fc-32fb-433a-9406-a6dcb6263b97 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:08.175306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6ce8b3fc-32fb-433a-9406-a6dcb6263b97 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:08.182782 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ce8b3fc-32fb-433a-9406-a6dcb6263b97 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:08.183215 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ce8b3fc-32fb-433a-9406-a6dcb6263b97 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:08.183995 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ce8b3fc-32fb-433a-9406-a6dcb6263b97 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:08.184476 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ce8b3fc-32fb-433a-9406-a6dcb6263b97 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:08.304380 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9b38ccc7-d0d8-4d27-b197-41ed6d59727c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:08.304992 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9b38ccc7-d0d8-4d27-b197-41ed6d59727c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:08.311988 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b38ccc7-d0d8-4d27-b197-41ed6d59727c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:08.312430 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b38ccc7-d0d8-4d27-b197-41ed6d59727c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:08.313219 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b38ccc7-d0d8-4d27-b197-41ed6d59727c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:08.313646 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b38ccc7-d0d8-4d27-b197-41ed6d59727c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:08.334871 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6ce8b3fc-32fb-433a-9406-a6dcb6263b97 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:08.344304 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6ce8b3fc-32fb-433a-9406-a6dcb6263b97 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:08.346091 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6ce8b3fc-32fb-433a-9406-a6dcb6263b97 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:08.347242 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6ce8b3fc-32fb-433a-9406-a6dcb6263b97 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.176554 Jul 31 20:03:08.347932 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 240/482] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:08 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:08.379602 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b38ccc7-d0d8-4d27-b197-41ed6d59727c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:08.387854 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9b38ccc7-d0d8-4d27-b197-41ed6d59727c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1614 microversion: 2.1 time: 0.089262 Jul 31 20:03:08.388782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 243/483] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:08 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:08.793584 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e3ceee98-d205-4f73-8d01-845cd7fd0fa5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:08.794198 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e3ceee98-d205-4f73-8d01-845cd7fd0fa5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:08.800406 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e3ceee98-d205-4f73-8d01-845cd7fd0fa5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:08.800847 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e3ceee98-d205-4f73-8d01-845cd7fd0fa5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:08.801626 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e3ceee98-d205-4f73-8d01-845cd7fd0fa5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:08.802053 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e3ceee98-d205-4f73-8d01-845cd7fd0fa5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:08.948426 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e3ceee98-d205-4f73-8d01-845cd7fd0fa5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:08.956721 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e3ceee98-d205-4f73-8d01-845cd7fd0fa5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.167102 Jul 31 20:03:08.957417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 241/484] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:08 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:09.371097 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4a1a08c8-0a39-4913-bd33-bd152d5c19e0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:09.371751 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4a1a08c8-0a39-4913-bd33-bd152d5c19e0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:09.379106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a1a08c8-0a39-4913-bd33-bd152d5c19e0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:09.379646 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a1a08c8-0a39-4913-bd33-bd152d5c19e0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:09.380726 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a1a08c8-0a39-4913-bd33-bd152d5c19e0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:09.382048 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a1a08c8-0a39-4913-bd33-bd152d5c19e0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:09.409329 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e14a9c77-f531-4127-aadd-6e3f4107e1d7 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:09.410730 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e14a9c77-f531-4127-aadd-6e3f4107e1d7 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:09.418835 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e14a9c77-f531-4127-aadd-6e3f4107e1d7 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:09.419641 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e14a9c77-f531-4127-aadd-6e3f4107e1d7 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:09.420673 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e14a9c77-f531-4127-aadd-6e3f4107e1d7 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:09.421197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e14a9c77-f531-4127-aadd-6e3f4107e1d7 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:09.516269 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e14a9c77-f531-4127-aadd-6e3f4107e1d7 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:09.525471 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e14a9c77-f531-4127-aadd-6e3f4107e1d7 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1614 microversion: 2.1 time: 0.119872 Jul 31 20:03:09.539752 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 242/485] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:09 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1614 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:09.561477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4a1a08c8-0a39-4913-bd33-bd152d5c19e0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:09.569955 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4a1a08c8-0a39-4913-bd33-bd152d5c19e0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:09.571438 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4a1a08c8-0a39-4913-bd33-bd152d5c19e0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:09.572570 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4a1a08c8-0a39-4913-bd33-bd152d5c19e0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.206050 Jul 31 20:03:09.574308 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 244/486] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:09 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:09.978330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6198704a-4814-42fc-8503-42b512dbbb69 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:09.979607 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6198704a-4814-42fc-8503-42b512dbbb69 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:09.987021 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6198704a-4814-42fc-8503-42b512dbbb69 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:09.987832 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6198704a-4814-42fc-8503-42b512dbbb69 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:09.988831 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6198704a-4814-42fc-8503-42b512dbbb69 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:09.989649 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6198704a-4814-42fc-8503-42b512dbbb69 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:10.127556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6198704a-4814-42fc-8503-42b512dbbb69 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:10.134981 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6198704a-4814-42fc-8503-42b512dbbb69 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.160610 Jul 31 20:03:10.135537 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 243/487] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:09 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:10.549347 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1fa41c48-77b2-4ec4-a814-82dd73023bde tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:10.551197 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1fa41c48-77b2-4ec4-a814-82dd73023bde tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:10.559855 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1fa41c48-77b2-4ec4-a814-82dd73023bde tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:10.560391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1fa41c48-77b2-4ec4-a814-82dd73023bde tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:10.561437 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1fa41c48-77b2-4ec4-a814-82dd73023bde tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:10.561927 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1fa41c48-77b2-4ec4-a814-82dd73023bde tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:10.601357 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fb70469a-891b-4687-88fb-5ab1d4068d30 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:10.601979 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fb70469a-891b-4687-88fb-5ab1d4068d30 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:10.609492 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb70469a-891b-4687-88fb-5ab1d4068d30 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:10.616358 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb70469a-891b-4687-88fb-5ab1d4068d30 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:10.616358 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb70469a-891b-4687-88fb-5ab1d4068d30 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:10.616358 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb70469a-891b-4687-88fb-5ab1d4068d30 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:10.625885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1fa41c48-77b2-4ec4-a814-82dd73023bde tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:10.635930 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1fa41c48-77b2-4ec4-a814-82dd73023bde tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1614 microversion: 2.1 time: 0.092124 Jul 31 20:03:10.641699 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 245/488] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:10 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:10.768333 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fb70469a-891b-4687-88fb-5ab1d4068d30 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:10.776884 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fb70469a-891b-4687-88fb-5ab1d4068d30 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:10.778534 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fb70469a-891b-4687-88fb-5ab1d4068d30 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:10.779686 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fb70469a-891b-4687-88fb-5ab1d4068d30 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.182280 Jul 31 20:03:10.780253 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 244/489] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:10 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:03:11.156102 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a6610e61-d244-4387-8612-b77150c162b2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:11.156611 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a6610e61-d244-4387-8612-b77150c162b2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:11.163184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6610e61-d244-4387-8612-b77150c162b2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:11.163613 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6610e61-d244-4387-8612-b77150c162b2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:11.164358 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6610e61-d244-4387-8612-b77150c162b2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:11.164778 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6610e61-d244-4387-8612-b77150c162b2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:11.311521 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a6610e61-d244-4387-8612-b77150c162b2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:11.318958 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a6610e61-d244-4387-8612-b77150c162b2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.166787 Jul 31 20:03:11.319516 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 246/490] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:11 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:11.657897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1b3dbe5a-3e28-441c-95df-9ede65a66e68 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:11.658575 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1b3dbe5a-3e28-441c-95df-9ede65a66e68 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:11.665429 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b3dbe5a-3e28-441c-95df-9ede65a66e68 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:11.665897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b3dbe5a-3e28-441c-95df-9ede65a66e68 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:11.666658 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b3dbe5a-3e28-441c-95df-9ede65a66e68 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:11.667082 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b3dbe5a-3e28-441c-95df-9ede65a66e68 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:11.742477 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1b3dbe5a-3e28-441c-95df-9ede65a66e68 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:11.746532 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:11.751619 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1b3dbe5a-3e28-441c-95df-9ede65a66e68 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1614 microversion: 2.1 time: 0.097674 Jul 31 20:03:11.752180 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 245/491] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:11 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:11.803546 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bd58ebd9-9b09-4064-9a4e-3e5925acc3ad tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:11.804268 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bd58ebd9-9b09-4064-9a4e-3e5925acc3ad tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:11.810876 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd58ebd9-9b09-4064-9a4e-3e5925acc3ad tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:11.811304 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd58ebd9-9b09-4064-9a4e-3e5925acc3ad tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:11.812053 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd58ebd9-9b09-4064-9a4e-3e5925acc3ad tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:11.812731 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd58ebd9-9b09-4064-9a4e-3e5925acc3ad tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:11.956104 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd58ebd9-9b09-4064-9a4e-3e5925acc3ad tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:11.965209 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd58ebd9-9b09-4064-9a4e-3e5925acc3ad tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:11.966727 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd58ebd9-9b09-4064-9a4e-3e5925acc3ad tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:11.967869 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bd58ebd9-9b09-4064-9a4e-3e5925acc3ad tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.168378 Jul 31 20:03:11.968416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 247/492] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:11 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:12.294080 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-95206961", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1722570919", "security_groups": [{"name": "tempest-secgroup-smoke-305261067"}], "networks": [{"uuid": "ec4cb8ea-def0-4d29-9194-7dbd6540d973"}], "block_device_mapping_v2": [{"uuid": "cb4a338d-97d2-44f6-846f-acd4a8e6068a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:12.339961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-226639f8-dcaf-47dc-a839-cdb63d313342 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:12.340690 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-226639f8-dcaf-47dc-a839-cdb63d313342 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:12.347117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-226639f8-dcaf-47dc-a839-cdb63d313342 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:12.347559 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-226639f8-dcaf-47dc-a839-cdb63d313342 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:12.348265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-226639f8-dcaf-47dc-a839-cdb63d313342 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:12.348714 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-226639f8-dcaf-47dc-a839-cdb63d313342 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:12.462535 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] validate_networks() for [('ec4cb8ea-def0-4d29-9194-7dbd6540d973', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:03:12.565252 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-226639f8-dcaf-47dc-a839-cdb63d313342 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:12.573221 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-226639f8-dcaf-47dc-a839-cdb63d313342 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.237199 Jul 31 20:03:12.573814 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 248/493] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:12 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:12.772903 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e08c52de-198b-4ba3-9373-02855e8861b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:12.773647 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e08c52de-198b-4ba3-9373-02855e8861b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:12.780397 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e08c52de-198b-4ba3-9373-02855e8861b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:12.780832 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e08c52de-198b-4ba3-9373-02855e8861b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:12.781623 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e08c52de-198b-4ba3-9373-02855e8861b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:12.782049 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e08c52de-198b-4ba3-9373-02855e8861b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:12.881412 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e08c52de-198b-4ba3-9373-02855e8861b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:12.889285 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e08c52de-198b-4ba3-9373-02855e8861b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1614 microversion: 2.1 time: 0.120377 Jul 31 20:03:12.889828 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 249/494] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:12 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1614 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:12.916819 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:03:12.917341 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:03:12.917959 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:03:12.918424 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:03:12.918849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:03:12.928845 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:12.929327 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:12.930128 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:12.930570 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:12.948632 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Getting quotas for project d5a9021b3b804f58a2a4e73676bfc480. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:03:12.952837 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Getting quotas for user 73f54d49acf0427e843caddf99e66277 and project d5a9021b3b804f58a2a4e73676bfc480. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:03:12.994214 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-abb6196b-d285-4496-9a5c-7006cf9d879f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:12.995361 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-abb6196b-d285-4496-9a5c-7006cf9d879f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:13.002307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abb6196b-d285-4496-9a5c-7006cf9d879f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:13.002749 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abb6196b-d285-4496-9a5c-7006cf9d879f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:13.003518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abb6196b-d285-4496-9a5c-7006cf9d879f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:13.004120 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abb6196b-d285-4496-9a5c-7006cf9d879f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:13.014366 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:03:13.016512 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb4a338d-97d2-44f6-846f-acd4a8e6068a',volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:03:13.126297 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:13.155063 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-20d9a2c2-b16c-4172-8f52-41d81a1c7ec0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.864860 Jul 31 20:03:13.161317 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 246/495] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:03:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:03:13.167089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-edc0fbdb-d497-4836-8ede-6d1dbd7e9255 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:13.167718 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-edc0fbdb-d497-4836-8ede-6d1dbd7e9255 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:13.259683 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-edc0fbdb-d497-4836-8ede-6d1dbd7e9255 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:13.268103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-edc0fbdb-d497-4836-8ede-6d1dbd7e9255 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1087 microversion: 2.1 time: 0.105020 Jul 31 20:03:13.268829 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 247/496] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:13 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1087 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:03:13.322463 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-abb6196b-d285-4496-9a5c-7006cf9d879f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:13.333028 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-abb6196b-d285-4496-9a5c-7006cf9d879f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:13.335068 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-abb6196b-d285-4496-9a5c-7006cf9d879f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:13.336238 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-abb6196b-d285-4496-9a5c-7006cf9d879f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.346186 Jul 31 20:03:13.349609 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 250/497] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:12 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:03:13.596527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fe3408c3-fc5e-489a-9a98-911b5352e306 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:13.597472 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fe3408c3-fc5e-489a-9a98-911b5352e306 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:13.605980 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe3408c3-fc5e-489a-9a98-911b5352e306 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:13.606234 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe3408c3-fc5e-489a-9a98-911b5352e306 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:13.612943 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-98f4985b-5515-4391-820e-021a316393a0 req-705102c0-2dd3-475b-804e-394bdb2f6b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f2c15d-f549-4688-887c-c6ae18ac1b39", "tag": "635c81a2-0f42-4226-ac0b-56a4f733839f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:13.618842 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe3408c3-fc5e-489a-9a98-911b5352e306 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:13.619939 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe3408c3-fc5e-489a-9a98-911b5352e306 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:13.630920 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-98f4985b-5515-4391-820e-021a316393a0 req-705102c0-2dd3-475b-804e-394bdb2f6b31 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:13.631465 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-98f4985b-5515-4391-820e-021a316393a0 req-705102c0-2dd3-475b-804e-394bdb2f6b31 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:13.647932 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-98f4985b-5515-4391-820e-021a316393a0 req-705102c0-2dd3-475b-804e-394bdb2f6b31 service nova] Creating event network-changed:635c81a2-0f42-4226-ac0b-56a4f733839f for instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 on hv-cinder-84984 Jul 31 20:03:13.657962 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-98f4985b-5515-4391-820e-021a316393a0 req-705102c0-2dd3-475b-804e-394bdb2f6b31 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048831 Jul 31 20:03:13.658500 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 251/498] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:13.777780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fe3408c3-fc5e-489a-9a98-911b5352e306 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:13.785977 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fe3408c3-fc5e-489a-9a98-911b5352e306 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.194923 Jul 31 20:03:13.786545 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 248/499] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:13 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:13.912445 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f45bbe10-4785-4bb0-8364-d7e0b87be926 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:13.913056 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f45bbe10-4785-4bb0-8364-d7e0b87be926 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:13.922219 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f45bbe10-4785-4bb0-8364-d7e0b87be926 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:13.922689 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f45bbe10-4785-4bb0-8364-d7e0b87be926 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:13.923541 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f45bbe10-4785-4bb0-8364-d7e0b87be926 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:13.923983 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f45bbe10-4785-4bb0-8364-d7e0b87be926 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:13.956110 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f45bbe10-4785-4bb0-8364-d7e0b87be926 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:13.956555 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f45bbe10-4785-4bb0-8364-d7e0b87be926 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:13.957006 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-f45bbe10-4785-4bb0-8364-d7e0b87be926 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lazy-loading 'fault' on Instance uuid feed8b88-8df9-44a5-9520-0d723924fd1d {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:03:14.008396 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f45bbe10-4785-4bb0-8364-d7e0b87be926 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:14.016313 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f45bbe10-4785-4bb0-8364-d7e0b87be926 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 200 len: 1332 microversion: 2.1 time: 0.108210 Jul 31 20:03:14.016942 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 252/500] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:13 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:14.290528 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ce571bf1-661c-49bf-8418-1fe90a437f1f tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:14.291216 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ce571bf1-661c-49bf-8418-1fe90a437f1f tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:14.298762 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce571bf1-661c-49bf-8418-1fe90a437f1f tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:14.299204 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce571bf1-661c-49bf-8418-1fe90a437f1f tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:14.300039 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce571bf1-661c-49bf-8418-1fe90a437f1f tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:14.300470 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce571bf1-661c-49bf-8418-1fe90a437f1f tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:14.360840 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3f8968d0-4a64-4125-83b6-487e98788c7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:14.361516 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3f8968d0-4a64-4125-83b6-487e98788c7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:14.367563 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f8968d0-4a64-4125-83b6-487e98788c7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:14.368228 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f8968d0-4a64-4125-83b6-487e98788c7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:14.369142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f8968d0-4a64-4125-83b6-487e98788c7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:14.370152 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f8968d0-4a64-4125-83b6-487e98788c7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:14.376006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ce571bf1-661c-49bf-8418-1fe90a437f1f tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:14.389382 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ce571bf1-661c-49bf-8418-1fe90a437f1f tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1129 microversion: 2.1 time: 0.102808 Jul 31 20:03:14.390616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 249/501] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:14 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1129 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:14.599951 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3f8968d0-4a64-4125-83b6-487e98788c7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:14.608767 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3f8968d0-4a64-4125-83b6-487e98788c7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:14.610310 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3f8968d0-4a64-4125-83b6-487e98788c7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:14.611445 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3f8968d0-4a64-4125-83b6-487e98788c7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.255690 Jul 31 20:03:14.612008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 253/502] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:14 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:03:14.810935 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fc4b0c50-a532-4dc2-94fd-bc3045182dc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:14.811907 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fc4b0c50-a532-4dc2-94fd-bc3045182dc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:14.821884 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc4b0c50-a532-4dc2-94fd-bc3045182dc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:14.822585 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc4b0c50-a532-4dc2-94fd-bc3045182dc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:14.823798 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc4b0c50-a532-4dc2-94fd-bc3045182dc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:14.824467 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc4b0c50-a532-4dc2-94fd-bc3045182dc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:15.038288 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-da15fa1c-984d-4df2-958c-ff68e8e4ac9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:15.038894 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-da15fa1c-984d-4df2-958c-ff68e8e4ac9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:15.046480 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da15fa1c-984d-4df2-958c-ff68e8e4ac9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:15.047175 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da15fa1c-984d-4df2-958c-ff68e8e4ac9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:15.048093 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da15fa1c-984d-4df2-958c-ff68e8e4ac9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:15.048696 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da15fa1c-984d-4df2-958c-ff68e8e4ac9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:15.063965 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-da15fa1c-984d-4df2-958c-ff68e8e4ac9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-da15fa1c-984d-4df2-958c-ff68e8e4ac9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d HTTP/1.1 Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:03:15.065764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:03:15.067117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:03:15.067117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:03:15.067117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:03:15.067117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:03:15.067117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:03:15.067117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:03:15.067117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:03:15.067117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:03:15.067117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:03:15.067117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:03:15.067117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:03:15.067117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': 'feed8b88-8df9-44a5-9520-0d723924fd1d'} Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:03:15.067900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:03:15.069091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:03:15.070431 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-da15fa1c-984d-4df2-958c-ff68e8e4ac9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 404 to user: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:03:15.070431 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-da15fa1c-984d-4df2-958c-ff68e8e4ac9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 404 len: 111 microversion: 2.1 time: 0.033003 Jul 31 20:03:15.071225 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 254/503] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:15 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:03:15.076385 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-62ca96c2-42ac-4ae6-a151-f9a584bd0d65 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '.version_select at 0x7ffa249005e0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:15.097187 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-62ca96c2-42ac-4ae6-a151-f9a584bd0d65 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333098639" status: 202 len: 0 microversion: 2.1 time: 0.024876 Jul 31 20:03:15.097781 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 255/504] 10.222.0.48 () {58 vars in 1221 bytes} [Sun Jul 31 20:03:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333098639 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:03:15.106890 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fc4b0c50-a532-4dc2-94fd-bc3045182dc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:15.116093 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fc4b0c50-a532-4dc2-94fd-bc3045182dc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.311360 Jul 31 20:03:15.117093 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 250/505] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:14 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:15.410948 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d878b4cc-1c6d-4ae5-91ea-c63be732869c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:15.411904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d878b4cc-1c6d-4ae5-91ea-c63be732869c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:15.419132 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d878b4cc-1c6d-4ae5-91ea-c63be732869c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:15.419870 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d878b4cc-1c6d-4ae5-91ea-c63be732869c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:15.420857 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d878b4cc-1c6d-4ae5-91ea-c63be732869c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:15.421571 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d878b4cc-1c6d-4ae5-91ea-c63be732869c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:15.543468 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d878b4cc-1c6d-4ae5-91ea-c63be732869c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:15.552901 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d878b4cc-1c6d-4ae5-91ea-c63be732869c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1203 microversion: 2.1 time: 0.145881 Jul 31 20:03:15.553658 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 256/506] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:15 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1203 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:15.636143 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d1bf8ddb-c79f-40df-ac59-0ebc421c65ee tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:15.637385 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d1bf8ddb-c79f-40df-ac59-0ebc421c65ee tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:15.645009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1bf8ddb-c79f-40df-ac59-0ebc421c65ee tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:15.645944 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1bf8ddb-c79f-40df-ac59-0ebc421c65ee tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:15.646994 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1bf8ddb-c79f-40df-ac59-0ebc421c65ee tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:15.647658 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1bf8ddb-c79f-40df-ac59-0ebc421c65ee tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:15.793048 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-df8bfc73-c2be-448a-bff7-0e0c7c1cffd2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:15.793596 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-df8bfc73-c2be-448a-bff7-0e0c7c1cffd2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:15.799741 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df8bfc73-c2be-448a-bff7-0e0c7c1cffd2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:15.800178 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df8bfc73-c2be-448a-bff7-0e0c7c1cffd2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:15.800927 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df8bfc73-c2be-448a-bff7-0e0c7c1cffd2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:15.801387 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df8bfc73-c2be-448a-bff7-0e0c7c1cffd2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:15.877033 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d1bf8ddb-c79f-40df-ac59-0ebc421c65ee tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:15.885808 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d1bf8ddb-c79f-40df-ac59-0ebc421c65ee tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:15.887350 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d1bf8ddb-c79f-40df-ac59-0ebc421c65ee tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:15.888532 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d1bf8ddb-c79f-40df-ac59-0ebc421c65ee tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.257599 Jul 31 20:03:15.904240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 251/507] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:15 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:15.934153 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-df8bfc73-c2be-448a-bff7-0e0c7c1cffd2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lazy-loading 'services' on Instance uuid 176aa7ed-3c42-4749-852d-a397673e4e57 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:03:16.066131 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-df8bfc73-c2be-448a-bff7-0e0c7c1cffd2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/os-volume_attachments/f71fa441-f59a-4baa-a29c-715824bb83cb" status: 202 len: 0 microversion: 2.1 time: 0.276853 Jul 31 20:03:16.066894 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 257/508] 10.222.0.48 () {58 vars in 1416 bytes} [Sun Jul 31 20:03:15 2022] DELETE /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/os-volume_attachments/f71fa441-f59a-4baa-a29c-715824bb83cb => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 20:03:16.075441 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d75faadb-82b3-4d90-a962-c751e0b3df10 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:16.077780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d75faadb-82b3-4d90-a962-c751e0b3df10 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:16.084475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d75faadb-82b3-4d90-a962-c751e0b3df10 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:16.084926 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d75faadb-82b3-4d90-a962-c751e0b3df10 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:16.085740 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d75faadb-82b3-4d90-a962-c751e0b3df10 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:16.086177 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d75faadb-82b3-4d90-a962-c751e0b3df10 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:16.116725 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d75faadb-82b3-4d90-a962-c751e0b3df10 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045501 Jul 31 20:03:16.117319 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 252/509] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:03:16 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:16.138498 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b133cbdd-d57d-468a-bbb0-4ab144b9e895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:16.139209 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b133cbdd-d57d-468a-bbb0-4ab144b9e895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:16.145784 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b133cbdd-d57d-468a-bbb0-4ab144b9e895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:16.146317 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b133cbdd-d57d-468a-bbb0-4ab144b9e895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:16.147157 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b133cbdd-d57d-468a-bbb0-4ab144b9e895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:16.147588 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b133cbdd-d57d-468a-bbb0-4ab144b9e895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:16.150405 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:16.286389 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b133cbdd-d57d-468a-bbb0-4ab144b9e895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:16.294452 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b133cbdd-d57d-468a-bbb0-4ab144b9e895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.160414 Jul 31 20:03:16.295237 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 258/510] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:16 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:16.575464 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2f97c64c-e478-4bb6-880a-ba4338df3400 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:16.576107 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2f97c64c-e478-4bb6-880a-ba4338df3400 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:16.582639 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f97c64c-e478-4bb6-880a-ba4338df3400 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:16.583084 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f97c64c-e478-4bb6-880a-ba4338df3400 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:16.583840 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f97c64c-e478-4bb6-880a-ba4338df3400 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:16.584269 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f97c64c-e478-4bb6-880a-ba4338df3400 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:16.720837 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2f97c64c-e478-4bb6-880a-ba4338df3400 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:16.730612 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2f97c64c-e478-4bb6-880a-ba4338df3400 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1270 microversion: 2.1 time: 0.158767 Jul 31 20:03:16.731388 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 253/511] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:16 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:16.912704 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-476ab2c4-9486-41d9-b310-0391cc2f08fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:16.913706 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-476ab2c4-9486-41d9-b310-0391cc2f08fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:16.916782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:16.920444 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-476ab2c4-9486-41d9-b310-0391cc2f08fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:16.920908 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-476ab2c4-9486-41d9-b310-0391cc2f08fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:16.921868 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-476ab2c4-9486-41d9-b310-0391cc2f08fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:16.922293 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-476ab2c4-9486-41d9-b310-0391cc2f08fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:17.129858 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-58d84c24-2865-43bb-9622-13bf9341f433 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:17.132369 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-58d84c24-2865-43bb-9622-13bf9341f433 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:17.136200 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-476ab2c4-9486-41d9-b310-0391cc2f08fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:17.139355 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58d84c24-2865-43bb-9622-13bf9341f433 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:17.139799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58d84c24-2865-43bb-9622-13bf9341f433 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:17.140573 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58d84c24-2865-43bb-9622-13bf9341f433 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:17.140993 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58d84c24-2865-43bb-9622-13bf9341f433 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:17.145050 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-476ab2c4-9486-41d9-b310-0391cc2f08fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:17.146651 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-476ab2c4-9486-41d9-b310-0391cc2f08fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:17.147800 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-476ab2c4-9486-41d9-b310-0391cc2f08fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.239386 Jul 31 20:03:17.148353 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 259/512] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:16 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:17.177373 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-58d84c24-2865-43bb-9622-13bf9341f433 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051890 Jul 31 20:03:17.177978 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 254/513] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:03:17 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:17.317703 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9d44e97e-1ce5-43dd-ad8b-7db3422521ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:17.318404 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9d44e97e-1ce5-43dd-ad8b-7db3422521ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:17.325203 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d44e97e-1ce5-43dd-ad8b-7db3422521ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:17.325957 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d44e97e-1ce5-43dd-ad8b-7db3422521ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:17.326730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d44e97e-1ce5-43dd-ad8b-7db3422521ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:17.327148 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d44e97e-1ce5-43dd-ad8b-7db3422521ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:17.405836 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-ccfd7501-b229-4254-b174-1a9e2633bc2c req-432e4efc-290c-4dd6-a0f1-feb85baaced0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9564a93e-d735-4c3b-916b-8e6c325e4b86", "tag": "5404fa72-b0c7-496c-a13f-4c664ba48b5c"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:17.415561 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-ccfd7501-b229-4254-b174-1a9e2633bc2c req-432e4efc-290c-4dd6-a0f1-feb85baaced0 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:17.416055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-ccfd7501-b229-4254-b174-1a9e2633bc2c req-432e4efc-290c-4dd6-a0f1-feb85baaced0 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:17.428586 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-ccfd7501-b229-4254-b174-1a9e2633bc2c req-432e4efc-290c-4dd6-a0f1-feb85baaced0 service nova] Creating event network-changed:5404fa72-b0c7-496c-a13f-4c664ba48b5c for instance 9564a93e-d735-4c3b-916b-8e6c325e4b86 on hv-cinder-84984 Jul 31 20:03:17.433468 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-ccfd7501-b229-4254-b174-1a9e2633bc2c req-432e4efc-290c-4dd6-a0f1-feb85baaced0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031850 Jul 31 20:03:17.434165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 255/514] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:17.511952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9d44e97e-1ce5-43dd-ad8b-7db3422521ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:17.520071 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9d44e97e-1ce5-43dd-ad8b-7db3422521ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.206157 Jul 31 20:03:17.520624 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 260/515] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:17 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:17.752924 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2efc25e6-466d-4bd7-9b02-612d417fb9ee tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:17.753707 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2efc25e6-466d-4bd7-9b02-612d417fb9ee tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:17.760639 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2efc25e6-466d-4bd7-9b02-612d417fb9ee tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:17.761053 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2efc25e6-466d-4bd7-9b02-612d417fb9ee tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:17.762149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2efc25e6-466d-4bd7-9b02-612d417fb9ee tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:17.762588 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2efc25e6-466d-4bd7-9b02-612d417fb9ee tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.162904 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2efc25e6-466d-4bd7-9b02-612d417fb9ee tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:18.171336 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fc5f51b6-4d2a-4eb0-93a1-eb43eede2d83 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:18.172018 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fc5f51b6-4d2a-4eb0-93a1-eb43eede2d83 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:18.173167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2efc25e6-466d-4bd7-9b02-612d417fb9ee tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1258 microversion: 2.1 time: 0.423661 Jul 31 20:03:18.173945 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 256/516] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:17 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1258 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:18.178693 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc5f51b6-4d2a-4eb0-93a1-eb43eede2d83 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:18.179146 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc5f51b6-4d2a-4eb0-93a1-eb43eede2d83 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.179902 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc5f51b6-4d2a-4eb0-93a1-eb43eede2d83 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:18.180534 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc5f51b6-4d2a-4eb0-93a1-eb43eede2d83 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.190272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2b533f92-9cb4-4703-b87d-1041e463fe48 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:18.192453 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2b533f92-9cb4-4703-b87d-1041e463fe48 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:18.199853 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2b533f92-9cb4-4703-b87d-1041e463fe48 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:18.200492 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2b533f92-9cb4-4703-b87d-1041e463fe48 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.201322 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2b533f92-9cb4-4703-b87d-1041e463fe48 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:18.202353 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2b533f92-9cb4-4703-b87d-1041e463fe48 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.231343 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2b533f92-9cb4-4703-b87d-1041e463fe48 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044959 Jul 31 20:03:18.232119 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 257/517] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:03:18 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 20:03:18.274538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-658c2aa3-81a5-4cfe-b2a4-02f9ea3ca5a6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:18.289597 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-658c2aa3-81a5-4cfe-b2a4-02f9ea3ca5a6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:18.305547 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-658c2aa3-81a5-4cfe-b2a4-02f9ea3ca5a6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:18.306235 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-658c2aa3-81a5-4cfe-b2a4-02f9ea3ca5a6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.307215 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-658c2aa3-81a5-4cfe-b2a4-02f9ea3ca5a6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:18.307856 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-658c2aa3-81a5-4cfe-b2a4-02f9ea3ca5a6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.403394 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fc5f51b6-4d2a-4eb0-93a1-eb43eede2d83 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:18.420219 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fc5f51b6-4d2a-4eb0-93a1-eb43eede2d83 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:18.421862 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fc5f51b6-4d2a-4eb0-93a1-eb43eede2d83 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:18.423287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fc5f51b6-4d2a-4eb0-93a1-eb43eede2d83 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.255957 Jul 31 20:03:18.425950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 261/518] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:18 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:18.473703 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65dd8e5d-e326-4bae-9047-58f8dc5b396a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:18.474377 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-65dd8e5d-e326-4bae-9047-58f8dc5b396a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:18.482472 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-658c2aa3-81a5-4cfe-b2a4-02f9ea3ca5a6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lazy-loading 'services' on Instance uuid bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:03:18.482671 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65dd8e5d-e326-4bae-9047-58f8dc5b396a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:18.483073 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65dd8e5d-e326-4bae-9047-58f8dc5b396a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.483904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65dd8e5d-e326-4bae-9047-58f8dc5b396a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:18.484336 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65dd8e5d-e326-4bae-9047-58f8dc5b396a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.513079 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-65dd8e5d-e326-4bae-9047-58f8dc5b396a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:03:18.609500 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-658c2aa3-81a5-4cfe-b2a4-02f9ea3ca5a6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/os-volume_attachments/759587bb-0722-4710-9f06-09b802eed0bc" status: 202 len: 0 microversion: 2.1 time: 0.340619 Jul 31 20:03:18.610116 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 258/519] 10.222.0.48 () {58 vars in 1416 bytes} [Sun Jul 31 20:03:18 2022] DELETE /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/os-volume_attachments/759587bb-0722-4710-9f06-09b802eed0bc => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:03:18.614864 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-65dd8e5d-e326-4bae-9047-58f8dc5b396a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 204 len: 0 microversion: 2.1 time: 0.145788 Jul 31 20:03:18.616197 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 262/520] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:03:18 2022] DELETE /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 20:03:18.625142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d2d6fb56-cf5a-4439-a5e4-c573aa74b1fe tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:18.625876 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d2d6fb56-cf5a-4439-a5e4-c573aa74b1fe tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:18.628828 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3774bceb-d3e7-473e-be46-92777aa20606 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:18.630535 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3774bceb-d3e7-473e-be46-92777aa20606 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:18.634572 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2d6fb56-cf5a-4439-a5e4-c573aa74b1fe tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:18.635020 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2d6fb56-cf5a-4439-a5e4-c573aa74b1fe tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.635873 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2d6fb56-cf5a-4439-a5e4-c573aa74b1fe tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:18.636309 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2d6fb56-cf5a-4439-a5e4-c573aa74b1fe tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.638659 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3774bceb-d3e7-473e-be46-92777aa20606 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:18.639600 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3774bceb-d3e7-473e-be46-92777aa20606 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.641773 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3774bceb-d3e7-473e-be46-92777aa20606 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:18.641971 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3774bceb-d3e7-473e-be46-92777aa20606 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.899316 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3774bceb-d3e7-473e-be46-92777aa20606 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:18.901885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d2d6fb56-cf5a-4439-a5e4-c573aa74b1fe tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:18.907462 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3774bceb-d3e7-473e-be46-92777aa20606 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.295912 Jul 31 20:03:18.908009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 259/521] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:18 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:18.909728 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d2d6fb56-cf5a-4439-a5e4-c573aa74b1fe tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1682 microversion: 2.1 time: 0.289000 Jul 31 20:03:18.910440 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 263/522] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:18 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1682 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:03:18.912353 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-46fe1ce2-2845-480e-a501-6fc0d8e2b2c4 req-a43cd586-048b-4082-81ba-a4243a44c085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb0b91c-9a78-49a1-a96b-016c09759655", "name": "network-vif-plugged", "status": "completed", "tag": "eaea7f4e-af98-4acb-9edb-366b7b6e28d8"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:18.921676 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-46fe1ce2-2845-480e-a501-6fc0d8e2b2c4 req-a43cd586-048b-4082-81ba-a4243a44c085 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:18.922107 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-46fe1ce2-2845-480e-a501-6fc0d8e2b2c4 req-a43cd586-048b-4082-81ba-a4243a44c085 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:18.933735 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-46fe1ce2-2845-480e-a501-6fc0d8e2b2c4 req-a43cd586-048b-4082-81ba-a4243a44c085 service nova] Creating event network-vif-plugged:eaea7f4e-af98-4acb-9edb-366b7b6e28d8 for instance cdb0b91c-9a78-49a1-a96b-016c09759655 on hv-cinder-84984 Jul 31 20:03:18.938899 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-46fe1ce2-2845-480e-a501-6fc0d8e2b2c4 req-a43cd586-048b-4082-81ba-a4243a44c085 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029797 Jul 31 20:03:18.939462 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 260/523] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:19.202646 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d963a7d8-1ab9-4da1-bef1-0dc0b78ca7fa tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:19.203871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d963a7d8-1ab9-4da1-bef1-0dc0b78ca7fa tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:19.215270 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d963a7d8-1ab9-4da1-bef1-0dc0b78ca7fa tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:19.216038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d963a7d8-1ab9-4da1-bef1-0dc0b78ca7fa tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:19.217011 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d963a7d8-1ab9-4da1-bef1-0dc0b78ca7fa tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:19.217560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d963a7d8-1ab9-4da1-bef1-0dc0b78ca7fa tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:19.353056 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d963a7d8-1ab9-4da1-bef1-0dc0b78ca7fa tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:19.361167 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d963a7d8-1ab9-4da1-bef1-0dc0b78ca7fa tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1258 microversion: 2.1 time: 0.164982 Jul 31 20:03:19.361718 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 264/524] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:19 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:19.452167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-07c91864-8a47-46bb-91ce-870654360661 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:19.452755 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-07c91864-8a47-46bb-91ce-870654360661 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:19.459909 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07c91864-8a47-46bb-91ce-870654360661 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:19.460351 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07c91864-8a47-46bb-91ce-870654360661 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:19.461102 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07c91864-8a47-46bb-91ce-870654360661 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:19.461567 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07c91864-8a47-46bb-91ce-870654360661 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:19.595658 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-07c91864-8a47-46bb-91ce-870654360661 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:19.604052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-07c91864-8a47-46bb-91ce-870654360661 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:19.605588 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-07c91864-8a47-46bb-91ce-870654360661 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:19.606862 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-07c91864-8a47-46bb-91ce-870654360661 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.161837 Jul 31 20:03:19.607417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 261/525] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:19 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:19.932318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-82ed86e5-7f8f-4622-9d72-32cc21f5603a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:19.933305 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-82ed86e5-7f8f-4622-9d72-32cc21f5603a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:19.933906 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-494aee77-cbcc-423b-898e-76d271dd2b51 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:19.934838 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-494aee77-cbcc-423b-898e-76d271dd2b51 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:19.943003 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82ed86e5-7f8f-4622-9d72-32cc21f5603a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:19.943687 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82ed86e5-7f8f-4622-9d72-32cc21f5603a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:19.944399 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-494aee77-cbcc-423b-898e-76d271dd2b51 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:19.944874 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82ed86e5-7f8f-4622-9d72-32cc21f5603a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:19.945094 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-494aee77-cbcc-423b-898e-76d271dd2b51 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:19.945567 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82ed86e5-7f8f-4622-9d72-32cc21f5603a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:19.946346 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-494aee77-cbcc-423b-898e-76d271dd2b51 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:19.947006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-494aee77-cbcc-423b-898e-76d271dd2b51 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:20.140332 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-82ed86e5-7f8f-4622-9d72-32cc21f5603a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:20.143488 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-494aee77-cbcc-423b-898e-76d271dd2b51 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:20.148156 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-82ed86e5-7f8f-4622-9d72-32cc21f5603a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.221786 Jul 31 20:03:20.148746 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 265/526] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:19 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:20.151413 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-494aee77-cbcc-423b-898e-76d271dd2b51 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1682 microversion: 2.1 time: 0.223401 Jul 31 20:03:20.151969 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 262/527] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:19 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:20.384526 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-535b726d-6ecf-4b1a-8940-aa91568c2b85 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:20.385843 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-535b726d-6ecf-4b1a-8940-aa91568c2b85 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:20.395910 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-535b726d-6ecf-4b1a-8940-aa91568c2b85 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:20.396602 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-535b726d-6ecf-4b1a-8940-aa91568c2b85 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:20.397988 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-535b726d-6ecf-4b1a-8940-aa91568c2b85 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:20.398562 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-535b726d-6ecf-4b1a-8940-aa91568c2b85 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:20.540743 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-535b726d-6ecf-4b1a-8940-aa91568c2b85 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:20.548278 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-535b726d-6ecf-4b1a-8940-aa91568c2b85 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1258 microversion: 2.1 time: 0.169300 Jul 31 20:03:20.548815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 266/528] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:20 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:20.633851 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-137a8f7f-597c-4e99-aa3d-c546fd9da854 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:20.634647 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-137a8f7f-597c-4e99-aa3d-c546fd9da854 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:20.645045 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-137a8f7f-597c-4e99-aa3d-c546fd9da854 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:20.645833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-137a8f7f-597c-4e99-aa3d-c546fd9da854 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:20.647024 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-137a8f7f-597c-4e99-aa3d-c546fd9da854 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:20.647656 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-137a8f7f-597c-4e99-aa3d-c546fd9da854 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:20.789461 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-137a8f7f-597c-4e99-aa3d-c546fd9da854 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:20.798137 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-137a8f7f-597c-4e99-aa3d-c546fd9da854 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:20.805441 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-137a8f7f-597c-4e99-aa3d-c546fd9da854 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:20.805441 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-137a8f7f-597c-4e99-aa3d-c546fd9da854 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.173925 Jul 31 20:03:20.805441 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 263/529] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:20 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:20.959645 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-d1066ae2-4362-4d06-a8df-25f1e251b1a5 req-dc89f95d-50aa-4f57-a325-60baff398004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f2c15d-f549-4688-887c-c6ae18ac1b39", "name": "network-vif-plugged", "status": "completed", "tag": "635c81a2-0f42-4226-ac0b-56a4f733839f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:20.975522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d1066ae2-4362-4d06-a8df-25f1e251b1a5 req-dc89f95d-50aa-4f57-a325-60baff398004 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:20.976234 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d1066ae2-4362-4d06-a8df-25f1e251b1a5 req-dc89f95d-50aa-4f57-a325-60baff398004 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:20.989699 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-d1066ae2-4362-4d06-a8df-25f1e251b1a5 req-dc89f95d-50aa-4f57-a325-60baff398004 service nova] Creating event network-vif-plugged:635c81a2-0f42-4226-ac0b-56a4f733839f for instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 on hv-cinder-84984 Jul 31 20:03:20.995077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-d1066ae2-4362-4d06-a8df-25f1e251b1a5 req-dc89f95d-50aa-4f57-a325-60baff398004 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041314 Jul 31 20:03:20.995656 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 267/530] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:21.173418 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4938f95e-11fb-4046-a381-551fbf308676 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:21.174538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4938f95e-11fb-4046-a381-551fbf308676 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:21.177045 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5ff40ffc-1355-4093-b642-ce555f82ff7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:21.178731 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5ff40ffc-1355-4093-b642-ce555f82ff7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:21.185267 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4938f95e-11fb-4046-a381-551fbf308676 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:21.185705 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4938f95e-11fb-4046-a381-551fbf308676 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:21.186474 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4938f95e-11fb-4046-a381-551fbf308676 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:21.186902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4938f95e-11fb-4046-a381-551fbf308676 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:21.187919 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ff40ffc-1355-4093-b642-ce555f82ff7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:21.188401 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ff40ffc-1355-4093-b642-ce555f82ff7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:21.189203 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ff40ffc-1355-4093-b642-ce555f82ff7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:21.189627 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ff40ffc-1355-4093-b642-ce555f82ff7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:21.384698 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4938f95e-11fb-4046-a381-551fbf308676 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:21.387713 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5ff40ffc-1355-4093-b642-ce555f82ff7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:21.388306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:21.393109 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4938f95e-11fb-4046-a381-551fbf308676 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.226322 Jul 31 20:03:21.394037 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 264/531] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:21 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:21.397068 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5ff40ffc-1355-4093-b642-ce555f82ff7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1682 microversion: 2.1 time: 0.226972 Jul 31 20:03:21.397683 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 268/532] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:21 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:21.573849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3872161b-3654-4f13-96b0-bb2b342da11d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:21.574718 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3872161b-3654-4f13-96b0-bb2b342da11d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:21.581886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3872161b-3654-4f13-96b0-bb2b342da11d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:21.582334 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3872161b-3654-4f13-96b0-bb2b342da11d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:21.583106 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3872161b-3654-4f13-96b0-bb2b342da11d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:21.583541 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3872161b-3654-4f13-96b0-bb2b342da11d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:21.718203 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3872161b-3654-4f13-96b0-bb2b342da11d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:21.725905 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3872161b-3654-4f13-96b0-bb2b342da11d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1258 microversion: 2.1 time: 0.159274 Jul 31 20:03:21.726484 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 265/533] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:21 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:21.825367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-11455315-0283-43bb-a23a-8c68cd09e168 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:21.825911 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-11455315-0283-43bb-a23a-8c68cd09e168 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:21.832362 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11455315-0283-43bb-a23a-8c68cd09e168 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:21.832804 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11455315-0283-43bb-a23a-8c68cd09e168 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:21.833637 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11455315-0283-43bb-a23a-8c68cd09e168 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:21.834062 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11455315-0283-43bb-a23a-8c68cd09e168 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:21.967652 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-11455315-0283-43bb-a23a-8c68cd09e168 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:21.979682 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-11455315-0283-43bb-a23a-8c68cd09e168 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:21.981946 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-11455315-0283-43bb-a23a-8c68cd09e168 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:21.983703 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-11455315-0283-43bb-a23a-8c68cd09e168 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.162262 Jul 31 20:03:21.984437 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 269/534] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:21 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:22.418144 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3a78c813-fd2d-4a6d-89f2-035876e3d68a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:22.418742 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3a78c813-fd2d-4a6d-89f2-035876e3d68a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:22.423102 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6e423357-c8ca-4e63-bd52-e34b96c0d8ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:22.423686 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6e423357-c8ca-4e63-bd52-e34b96c0d8ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:22.430592 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e423357-c8ca-4e63-bd52-e34b96c0d8ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:22.430788 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a78c813-fd2d-4a6d-89f2-035876e3d68a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:22.431037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a78c813-fd2d-4a6d-89f2-035876e3d68a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:22.431431 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e423357-c8ca-4e63-bd52-e34b96c0d8ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:22.432183 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a78c813-fd2d-4a6d-89f2-035876e3d68a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:22.432321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e423357-c8ca-4e63-bd52-e34b96c0d8ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:22.432675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e423357-c8ca-4e63-bd52-e34b96c0d8ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:22.432877 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a78c813-fd2d-4a6d-89f2-035876e3d68a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:22.855929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6e423357-c8ca-4e63-bd52-e34b96c0d8ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:22.866013 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6e423357-c8ca-4e63-bd52-e34b96c0d8ff tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.455320 Jul 31 20:03:22.866665 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 266/535] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:22 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:22.871778 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3a78c813-fd2d-4a6d-89f2-035876e3d68a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:22.872125 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a8fd512a-3a6e-4d13-9cb6-fb882d8924da tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:22.872824 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a8fd512a-3a6e-4d13-9cb6-fb882d8924da tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:22.880963 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a8fd512a-3a6e-4d13-9cb6-fb882d8924da tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:22.881439 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a8fd512a-3a6e-4d13-9cb6-fb882d8924da tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:22.882219 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a8fd512a-3a6e-4d13-9cb6-fb882d8924da tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:22.883010 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a8fd512a-3a6e-4d13-9cb6-fb882d8924da tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:22.884459 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3a78c813-fd2d-4a6d-89f2-035876e3d68a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1682 microversion: 2.1 time: 0.470034 Jul 31 20:03:22.896768 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 270/536] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:22 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1682 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:22.939355 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:22.942858 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1b90ac0d-549b-4d20-8b33-b20f3aa46d5b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:22.949281 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b90ac0d-549b-4d20-8b33-b20f3aa46d5b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:22.949810 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b90ac0d-549b-4d20-8b33-b20f3aa46d5b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:22.972184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1b90ac0d-549b-4d20-8b33-b20f3aa46d5b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Going to try to stop instance {{(pid=117920) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 20:03:23.017128 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1b90ac0d-549b-4d20-8b33-b20f3aa46d5b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "POST /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/action" status: 202 len: 0 microversion: 2.1 time: 0.078514 Jul 31 20:03:23.018025 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 271/537] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:03:22 2022] POST /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:03:23.023181 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b53d60d9-c2a8-482a-bc8b-eccef139e439 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:23.023681 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b53d60d9-c2a8-482a-bc8b-eccef139e439 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:23.035470 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b53d60d9-c2a8-482a-bc8b-eccef139e439 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:23.035855 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b53d60d9-c2a8-482a-bc8b-eccef139e439 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:23.036818 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b53d60d9-c2a8-482a-bc8b-eccef139e439 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:23.037271 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b53d60d9-c2a8-482a-bc8b-eccef139e439 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:23.139894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a8fd512a-3a6e-4d13-9cb6-fb882d8924da tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:23.147680 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a8fd512a-3a6e-4d13-9cb6-fb882d8924da tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1258 microversion: 2.1 time: 0.279670 Jul 31 20:03:23.148243 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 267/538] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:22 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1258 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:23.152767 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e4745dc0-0cd2-4e69-8f83-461c1dcf6355 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:23.153611 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e4745dc0-0cd2-4e69-8f83-461c1dcf6355 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:23.159281 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e4745dc0-0cd2-4e69-8f83-461c1dcf6355 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:23.159726 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e4745dc0-0cd2-4e69-8f83-461c1dcf6355 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:23.160500 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e4745dc0-0cd2-4e69-8f83-461c1dcf6355 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:23.161007 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e4745dc0-0cd2-4e69-8f83-461c1dcf6355 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:23.264842 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=8 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:23.319642 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b53d60d9-c2a8-482a-bc8b-eccef139e439 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:23.322562 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:23.331660 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b53d60d9-c2a8-482a-bc8b-eccef139e439 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:23.333917 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b53d60d9-c2a8-482a-bc8b-eccef139e439 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:23.335291 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b53d60d9-c2a8-482a-bc8b-eccef139e439 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.316390 Jul 31 20:03:23.335857 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 272/539] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:23 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:23.391778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e4745dc0-0cd2-4e69-8f83-461c1dcf6355 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:23.400071 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e4745dc0-0cd2-4e69-8f83-461c1dcf6355 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1676 microversion: 2.1 time: 0.250850 Jul 31 20:03:23.400763 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 268/540] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:23 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:23.727590 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1455d3a7-ded6-4544-b5cb-84253d0de4f9 req-3d82b9d9-39d4-49e0-946b-4ae6cf6301b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "176aa7ed-3c42-4749-852d-a397673e4e57", "name": "network-vif-deleted", "tag": "2a807f69-4e6e-4e5f-9403-2f792246e051"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:23.740670 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1455d3a7-ded6-4544-b5cb-84253d0de4f9 req-3d82b9d9-39d4-49e0-946b-4ae6cf6301b1 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:23.740978 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1455d3a7-ded6-4544-b5cb-84253d0de4f9 req-3d82b9d9-39d4-49e0-946b-4ae6cf6301b1 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:23.755607 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1455d3a7-ded6-4544-b5cb-84253d0de4f9 req-3d82b9d9-39d4-49e0-946b-4ae6cf6301b1 service nova] Creating event network-vif-deleted:2a807f69-4e6e-4e5f-9403-2f792246e051 for instance 176aa7ed-3c42-4749-852d-a397673e4e57 on hv-cinder-84984 Jul 31 20:03:23.761465 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1455d3a7-ded6-4544-b5cb-84253d0de4f9 req-3d82b9d9-39d4-49e0-946b-4ae6cf6301b1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037621 Jul 31 20:03:23.762246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 273/541] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:23.887440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a84c96da-61b7-4d7e-b26c-4d0322f39cdc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:23.888111 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a84c96da-61b7-4d7e-b26c-4d0322f39cdc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:23.895332 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a84c96da-61b7-4d7e-b26c-4d0322f39cdc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:23.895886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a84c96da-61b7-4d7e-b26c-4d0322f39cdc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:23.896730 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a84c96da-61b7-4d7e-b26c-4d0322f39cdc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:23.897179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a84c96da-61b7-4d7e-b26c-4d0322f39cdc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:23.908053 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02601e45-d9aa-40d0-96ca-a2a2f6818977 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:23.908832 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-02601e45-d9aa-40d0-96ca-a2a2f6818977 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:23.915066 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02601e45-d9aa-40d0-96ca-a2a2f6818977 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:23.915525 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02601e45-d9aa-40d0-96ca-a2a2f6818977 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:23.916251 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02601e45-d9aa-40d0-96ca-a2a2f6818977 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:23.916689 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02601e45-d9aa-40d0-96ca-a2a2f6818977 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:23.999524 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02601e45-d9aa-40d0-96ca-a2a2f6818977 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:24.007834 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-02601e45-d9aa-40d0-96ca-a2a2f6818977 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1614 microversion: 2.1 time: 0.104221 Jul 31 20:03:24.008597 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 274/542] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:23 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1614 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:24.056618 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a84c96da-61b7-4d7e-b26c-4d0322f39cdc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:24.064281 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a84c96da-61b7-4d7e-b26c-4d0322f39cdc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1358 microversion: 2.1 time: 0.180806 Jul 31 20:03:24.064864 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 269/543] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:23 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:24.168295 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-14ae7c3d-dbca-4f87-b74f-0b305ab43296 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:24.168908 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-14ae7c3d-dbca-4f87-b74f-0b305ab43296 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:24.175283 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14ae7c3d-dbca-4f87-b74f-0b305ab43296 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:24.175719 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14ae7c3d-dbca-4f87-b74f-0b305ab43296 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:24.176460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14ae7c3d-dbca-4f87-b74f-0b305ab43296 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:24.176879 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14ae7c3d-dbca-4f87-b74f-0b305ab43296 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:24.315846 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-14ae7c3d-dbca-4f87-b74f-0b305ab43296 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:24.323977 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-14ae7c3d-dbca-4f87-b74f-0b305ab43296 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1258 microversion: 2.1 time: 0.159361 Jul 31 20:03:24.326729 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 275/544] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:24 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:24.358702 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d90f1a6b-eae7-4b3d-919f-5662a068cb48 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:24.359381 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d90f1a6b-eae7-4b3d-919f-5662a068cb48 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:24.365631 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d90f1a6b-eae7-4b3d-919f-5662a068cb48 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:24.366075 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d90f1a6b-eae7-4b3d-919f-5662a068cb48 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:24.366841 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d90f1a6b-eae7-4b3d-919f-5662a068cb48 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:24.367346 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d90f1a6b-eae7-4b3d-919f-5662a068cb48 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:24.424580 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8e7232a3-272a-4b71-9220-c566b7c57675 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:24.425241 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8e7232a3-272a-4b71-9220-c566b7c57675 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:24.432747 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e7232a3-272a-4b71-9220-c566b7c57675 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:24.433433 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e7232a3-272a-4b71-9220-c566b7c57675 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:24.434288 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e7232a3-272a-4b71-9220-c566b7c57675 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:24.434900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e7232a3-272a-4b71-9220-c566b7c57675 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:24.565615 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d90f1a6b-eae7-4b3d-919f-5662a068cb48 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:24.576280 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d90f1a6b-eae7-4b3d-919f-5662a068cb48 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:24.578185 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d90f1a6b-eae7-4b3d-919f-5662a068cb48 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:24.579464 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d90f1a6b-eae7-4b3d-919f-5662a068cb48 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1808 microversion: 2.20 time: 0.224975 Jul 31 20:03:24.580421 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 270/545] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:24 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:24.634186 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8e7232a3-272a-4b71-9220-c566b7c57675 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:24.645263 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8e7232a3-272a-4b71-9220-c566b7c57675 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1676 microversion: 2.1 time: 0.226469 Jul 31 20:03:24.663197 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 276/546] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:24 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:03:25.030498 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e32f7252-dbd4-423d-b26a-a8fe7bff22be tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:25.031639 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e32f7252-dbd4-423d-b26a-a8fe7bff22be tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:25.038913 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e32f7252-dbd4-423d-b26a-a8fe7bff22be tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.039358 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e32f7252-dbd4-423d-b26a-a8fe7bff22be tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.040297 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e32f7252-dbd4-423d-b26a-a8fe7bff22be tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.040804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e32f7252-dbd4-423d-b26a-a8fe7bff22be tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.073686 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e32f7252-dbd4-423d-b26a-a8fe7bff22be tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.074138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e32f7252-dbd4-423d-b26a-a8fe7bff22be tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.074590 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-e32f7252-dbd4-423d-b26a-a8fe7bff22be tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lazy-loading 'fault' on Instance uuid 176aa7ed-3c42-4749-852d-a397673e4e57 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:03:25.085330 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-22bba432-32fd-42c1-a22d-1052f717db0f tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:25.085939 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-22bba432-32fd-42c1-a22d-1052f717db0f tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:25.092475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22bba432-32fd-42c1-a22d-1052f717db0f tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.092929 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22bba432-32fd-42c1-a22d-1052f717db0f tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.093724 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22bba432-32fd-42c1-a22d-1052f717db0f tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.094155 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22bba432-32fd-42c1-a22d-1052f717db0f tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.121766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e32f7252-dbd4-423d-b26a-a8fe7bff22be tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:25.129473 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e32f7252-dbd4-423d-b26a-a8fe7bff22be tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1331 microversion: 2.1 time: 0.103414 Jul 31 20:03:25.130027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 271/547] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:25 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:03:25.231564 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-22bba432-32fd-42c1-a22d-1052f717db0f tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:25.240077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-22bba432-32fd-42c1-a22d-1052f717db0f tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1548 microversion: 2.1 time: 0.158525 Jul 31 20:03:25.240649 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 277/548] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:25 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:03:25.265986 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-df13ecd9-5bbd-4316-8481-3f081deb77fc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:25.266588 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-df13ecd9-5bbd-4316-8481-3f081deb77fc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:25.274235 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-df13ecd9-5bbd-4316-8481-3f081deb77fc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.274678 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-df13ecd9-5bbd-4316-8481-3f081deb77fc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.275432 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-df13ecd9-5bbd-4316-8481-3f081deb77fc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.275855 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-df13ecd9-5bbd-4316-8481-3f081deb77fc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.345245 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-55364715-faec-4e0e-8457-1a6919c962b1 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:25.347241 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-55364715-faec-4e0e-8457-1a6919c962b1 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:25.354286 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55364715-faec-4e0e-8457-1a6919c962b1 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.354839 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55364715-faec-4e0e-8457-1a6919c962b1 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.355838 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55364715-faec-4e0e-8457-1a6919c962b1 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.356336 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55364715-faec-4e0e-8457-1a6919c962b1 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.445399 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-df13ecd9-5bbd-4316-8481-3f081deb77fc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:25.453441 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-df13ecd9-5bbd-4316-8481-3f081deb77fc tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1548 microversion: 2.1 time: 0.191601 Jul 31 20:03:25.467890 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 272/549] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:25 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1548 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:25.474592 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a491048b-1883-40cb-ab1b-56f3dfdced67 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:25.479892 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a491048b-1883-40cb-ab1b-56f3dfdced67 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:25.480731 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a491048b-1883-40cb-ab1b-56f3dfdced67 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Searching by: {'deleted': False, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5'} {{(pid=117919) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 20:03:25.488237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a491048b-1883-40cb-ab1b-56f3dfdced67 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.488703 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a491048b-1883-40cb-ab1b-56f3dfdced67 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.489975 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a491048b-1883-40cb-ab1b-56f3dfdced67 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.491011 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a491048b-1883-40cb-ab1b-56f3dfdced67 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.589097 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.multi_cell_list [None req-a491048b-1883-40cb-ab1b-56f3dfdced67 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 20:03:25.685839 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a491048b-1883-40cb-ab1b-56f3dfdced67 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214977 Jul 31 20:03:25.686438 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 273/550] 10.222.0.48 () {58 vars in 1125 bytes} [Sun Jul 31 20:03:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:25.693210 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cd58a6df-b695-445d-a04b-30b38ad7e18c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:25.693210 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cd58a6df-b695-445d-a04b-30b38ad7e18c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:25.698182 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd58a6df-b695-445d-a04b-30b38ad7e18c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.698633 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd58a6df-b695-445d-a04b-30b38ad7e18c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.699406 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd58a6df-b695-445d-a04b-30b38ad7e18c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.699837 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd58a6df-b695-445d-a04b-30b38ad7e18c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.789970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-55364715-faec-4e0e-8457-1a6919c962b1 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:25.798138 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-55364715-faec-4e0e-8457-1a6919c962b1 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1258 microversion: 2.1 time: 0.457422 Jul 31 20:03:25.799325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 278/551] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:25 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1258 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:25.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf0fb4be-2179-4092-b271-b5beeebe9797 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:25.804781 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cf0fb4be-2179-4092-b271-b5beeebe9797 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:25.811343 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf0fb4be-2179-4092-b271-b5beeebe9797 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.812670 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf0fb4be-2179-4092-b271-b5beeebe9797 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.813543 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf0fb4be-2179-4092-b271-b5beeebe9797 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.814028 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf0fb4be-2179-4092-b271-b5beeebe9797 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.907434 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cd58a6df-b695-445d-a04b-30b38ad7e18c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:25.916617 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cd58a6df-b695-445d-a04b-30b38ad7e18c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:25.918318 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cd58a6df-b695-445d-a04b-30b38ad7e18c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:25.919832 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cd58a6df-b695-445d-a04b-30b38ad7e18c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1795 microversion: 2.20 time: 0.231974 Jul 31 20:03:25.919978 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 274/552] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:03:25 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1795 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:03:25.925127 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c33b219a-78b8-4fca-9187-70699633a6e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:25.925850 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c33b219a-78b8-4fca-9187-70699633a6e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:25.933518 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c33b219a-78b8-4fca-9187-70699633a6e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.933972 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c33b219a-78b8-4fca-9187-70699633a6e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.934741 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c33b219a-78b8-4fca-9187-70699633a6e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:25.935157 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c33b219a-78b8-4fca-9187-70699633a6e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:25.991276 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cf0fb4be-2179-4092-b271-b5beeebe9797 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:25.999445 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf0fb4be-2179-4092-b271-b5beeebe9797 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1676 microversion: 2.1 time: 0.198986 Jul 31 20:03:26.000016 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 279/553] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:25 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1676 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:26.076692 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c33b219a-78b8-4fca-9187-70699633a6e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:26.084705 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c33b219a-78b8-4fca-9187-70699633a6e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1548 microversion: 2.1 time: 0.163803 Jul 31 20:03:26.085302 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 275/554] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:25 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:26.150541 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-91943e07-92ba-4ffa-a6ba-e6c097813d00 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:26.151214 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-91943e07-92ba-4ffa-a6ba-e6c097813d00 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:26.157757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-91943e07-92ba-4ffa-a6ba-e6c097813d00 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:26.158142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-91943e07-92ba-4ffa-a6ba-e6c097813d00 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:26.158911 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-91943e07-92ba-4ffa-a6ba-e6c097813d00 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:26.159328 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-91943e07-92ba-4ffa-a6ba-e6c097813d00 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:26.189544 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-91943e07-92ba-4ffa-a6ba-e6c097813d00 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:26.189999 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-91943e07-92ba-4ffa-a6ba-e6c097813d00 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:26.190473 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-91943e07-92ba-4ffa-a6ba-e6c097813d00 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lazy-loading 'fault' on Instance uuid 176aa7ed-3c42-4749-852d-a397673e4e57 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:03:26.232060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-91943e07-92ba-4ffa-a6ba-e6c097813d00 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:26.240440 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-91943e07-92ba-4ffa-a6ba-e6c097813d00 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 200 len: 1331 microversion: 2.1 time: 0.093694 Jul 31 20:03:26.241082 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 280/555] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:26 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:26.696538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-b24c5b84-4af2-46be-86e7-285df1102928 req-19a78b44-504a-4fbb-a807-e60448c7292d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9564a93e-d735-4c3b-916b-8e6c325e4b86", "name": "network-vif-plugged", "status": "completed", "tag": "5404fa72-b0c7-496c-a13f-4c664ba48b5c"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:26.706595 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-b24c5b84-4af2-46be-86e7-285df1102928 req-19a78b44-504a-4fbb-a807-e60448c7292d service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:26.707277 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-b24c5b84-4af2-46be-86e7-285df1102928 req-19a78b44-504a-4fbb-a807-e60448c7292d service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:26.721571 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-b24c5b84-4af2-46be-86e7-285df1102928 req-19a78b44-504a-4fbb-a807-e60448c7292d service nova] Creating event network-vif-plugged:5404fa72-b0c7-496c-a13f-4c664ba48b5c for instance 9564a93e-d735-4c3b-916b-8e6c325e4b86 on hv-cinder-84984 Jul 31 20:03:26.726789 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-b24c5b84-4af2-46be-86e7-285df1102928 req-19a78b44-504a-4fbb-a807-e60448c7292d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033973 Jul 31 20:03:26.727902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 276/556] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:26.820124 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cc6db0b4-fd3c-4ce4-b12b-265e5f0d6f14 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:26.820803 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cc6db0b4-fd3c-4ce4-b12b-265e5f0d6f14 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:26.827145 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc6db0b4-fd3c-4ce4-b12b-265e5f0d6f14 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:26.827671 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc6db0b4-fd3c-4ce4-b12b-265e5f0d6f14 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:26.828450 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc6db0b4-fd3c-4ce4-b12b-265e5f0d6f14 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:26.829170 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc6db0b4-fd3c-4ce4-b12b-265e5f0d6f14 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:26.976291 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cc6db0b4-fd3c-4ce4-b12b-265e5f0d6f14 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:26.984437 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cc6db0b4-fd3c-4ce4-b12b-265e5f0d6f14 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1258 microversion: 2.1 time: 0.168295 Jul 31 20:03:26.985094 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 281/557] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:26 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:27.021464 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b84fc809-c407-468d-b90b-7ed73f7eb775 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:27.022149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b84fc809-c407-468d-b90b-7ed73f7eb775 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:27.029069 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b84fc809-c407-468d-b90b-7ed73f7eb775 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:27.029545 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b84fc809-c407-468d-b90b-7ed73f7eb775 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:27.030299 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b84fc809-c407-468d-b90b-7ed73f7eb775 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:27.031058 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b84fc809-c407-468d-b90b-7ed73f7eb775 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:27.200462 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b84fc809-c407-468d-b90b-7ed73f7eb775 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:27.208439 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b84fc809-c407-468d-b90b-7ed73f7eb775 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1676 microversion: 2.1 time: 0.191261 Jul 31 20:03:27.209014 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 277/558] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:27 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:27.263950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d135fc62-436c-47b5-8485-e0be7d3354f6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:27.264561 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d135fc62-436c-47b5-8485-e0be7d3354f6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:27.271714 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d135fc62-436c-47b5-8485-e0be7d3354f6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:27.272210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d135fc62-436c-47b5-8485-e0be7d3354f6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:27.273078 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d135fc62-436c-47b5-8485-e0be7d3354f6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:27.273561 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d135fc62-436c-47b5-8485-e0be7d3354f6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:27.288931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-d135fc62-436c-47b5-8485-e0be7d3354f6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d135fc62-436c-47b5-8485-e0be7d3354f6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 HTTP/1.1 Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:03:27.290782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:03:27.292289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:03:27.292289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:03:27.292289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:03:27.292289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:03:27.292289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:03:27.292289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:03:27.292289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:03:27.292289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:03:27.292289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:03:27.292289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:03:27.292289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:03:27.292289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': '176aa7ed-3c42-4749-852d-a397673e4e57'} Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:03:27.293172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:03:27.294881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:03:27.296273 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d135fc62-436c-47b5-8485-e0be7d3354f6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 404 to user: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:03:27.296273 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d135fc62-436c-47b5-8485-e0be7d3354f6 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 404 len: 111 microversion: 2.1 time: 0.033771 Jul 31 20:03:27.296273 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 282/559] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:27 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:03:27.300954 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0fda200a-3505-4e64-bbc3-5df4581fde6f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '.version_select at 0x7ffa247c8dc0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:27.322300 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0fda200a-3505-4e64-bbc3-5df4581fde6f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358567791" status: 202 len: 0 microversion: 2.1 time: 0.025117 Jul 31 20:03:27.322841 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 278/560] 10.222.0.48 () {58 vars in 1221 bytes} [Sun Jul 31 20:03:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358567791 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:03:27.650370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-81158b27-c4cc-4293-bd38-80824f1a569d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac3c38f0-9fdd-4940-9537-f626b2e0630a"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:27.652766 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-81158b27-c4cc-4293-bd38-80824f1a569d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:27.658844 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81158b27-c4cc-4293-bd38-80824f1a569d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:27.659281 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81158b27-c4cc-4293-bd38-80824f1a569d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:27.660039 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81158b27-c4cc-4293-bd38-80824f1a569d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:27.660466 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81158b27-c4cc-4293-bd38-80824f1a569d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:27.955323 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-af6acc26-bedc-41ed-8e12-88b0f25b420d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Action: 'create', calling method: .version_select at 0x7ffa2489d5e0>, body: {"keypair": {"name": "tempest-keypair-571855253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWXmzI53+nNO3oYIUcQsyOCQE3X88sbMytjiwc72a2lN+qqLZ1ACs653ayOJCzsAUy6RIiodq0mxXBo20FjYtVJbnlxOrjsC7t+ZtpiWjM8CUWr28YRsDKX9WjKamRxfg=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:27.971908 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-af6acc26-bedc-41ed-8e12-88b0f25b420d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for project 2f435e60769a43deb3c15b351f97d62c. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:03:27.975838 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-af6acc26-bedc-41ed-8e12-88b0f25b420d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for user 76b9c24c8dc94af8b2c8e44be8494e9b and project 2f435e60769a43deb3c15b351f97d62c. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:03:28.001967 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-af6acc26-bedc-41ed-8e12-88b0f25b420d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050533 Jul 31 20:03:28.002540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 279/561] 10.222.0.48 () {60 vars in 1159 bytes} [Sun Jul 31 20:03:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:03:28.007226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6806be87-2cd0-4ecd-b929-8e48b9611a4e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:28.008070 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6806be87-2cd0-4ecd-b929-8e48b9611a4e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:28.015025 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6806be87-2cd0-4ecd-b929-8e48b9611a4e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:28.015473 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6806be87-2cd0-4ecd-b929-8e48b9611a4e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:28.016244 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6806be87-2cd0-4ecd-b929-8e48b9611a4e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:28.016671 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6806be87-2cd0-4ecd-b929-8e48b9611a4e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:28.201847 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-81158b27-c4cc-4293-bd38-80824f1a569d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "POST /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555020 Jul 31 20:03:28.204824 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6806be87-2cd0-4ecd-b929-8e48b9611a4e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:28.216374 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6806be87-2cd0-4ecd-b929-8e48b9611a4e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1258 microversion: 2.1 time: 0.212679 Jul 31 20:03:28.217258 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 280/562] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:28 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1258 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:28.219577 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 283/563] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:03:27 2022] POST /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:28.230055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-63f7b267-0cb3-489a-8303-24ae2cb5f31d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:28.230628 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-63f7b267-0cb3-489a-8303-24ae2cb5f31d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:28.240133 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63f7b267-0cb3-489a-8303-24ae2cb5f31d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:28.240584 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63f7b267-0cb3-489a-8303-24ae2cb5f31d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:28.241385 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63f7b267-0cb3-489a-8303-24ae2cb5f31d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:28.241815 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63f7b267-0cb3-489a-8303-24ae2cb5f31d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:28.458703 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-63f7b267-0cb3-489a-8303-24ae2cb5f31d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:28.467367 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-63f7b267-0cb3-489a-8303-24ae2cb5f31d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1676 microversion: 2.1 time: 0.241237 Jul 31 20:03:28.467946 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 281/564] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:28 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1676 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:29.240415 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3234ce9c-8758-4023-acbc-db46b70cd8ce tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:29.241422 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3234ce9c-8758-4023-acbc-db46b70cd8ce tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:29.248817 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3234ce9c-8758-4023-acbc-db46b70cd8ce tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:29.249297 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3234ce9c-8758-4023-acbc-db46b70cd8ce tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:29.250230 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3234ce9c-8758-4023-acbc-db46b70cd8ce tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:29.250654 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3234ce9c-8758-4023-acbc-db46b70cd8ce tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:29.397116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3234ce9c-8758-4023-acbc-db46b70cd8ce tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:29.406503 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3234ce9c-8758-4023-acbc-db46b70cd8ce tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1441 microversion: 2.1 time: 0.170889 Jul 31 20:03:29.407107 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 284/565] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:29 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1441 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:29.427678 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-191d021b-a167-4076-a579-9c2b63b07bf6 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:29.428275 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-191d021b-a167-4076-a579-9c2b63b07bf6 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:29.434390 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-191d021b-a167-4076-a579-9c2b63b07bf6 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:29.434877 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-191d021b-a167-4076-a579-9c2b63b07bf6 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:29.435830 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-191d021b-a167-4076-a579-9c2b63b07bf6 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:29.436263 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-191d021b-a167-4076-a579-9c2b63b07bf6 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:29.488823 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23b1f6d2-043f-42fe-a0e2-de6bb3d1f4f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:29.489464 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-23b1f6d2-043f-42fe-a0e2-de6bb3d1f4f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:29.496057 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23b1f6d2-043f-42fe-a0e2-de6bb3d1f4f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:29.496548 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23b1f6d2-043f-42fe-a0e2-de6bb3d1f4f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:29.497382 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23b1f6d2-043f-42fe-a0e2-de6bb3d1f4f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:29.497973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23b1f6d2-043f-42fe-a0e2-de6bb3d1f4f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:29.619179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-191d021b-a167-4076-a579-9c2b63b07bf6 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:29.631189 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-191d021b-a167-4076-a579-9c2b63b07bf6 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1441 microversion: 2.1 time: 0.207806 Jul 31 20:03:29.631773 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 282/566] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:29 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1441 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:29.674978 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-23b1f6d2-043f-42fe-a0e2-de6bb3d1f4f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:29.683038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-23b1f6d2-043f-42fe-a0e2-de6bb3d1f4f8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1676 microversion: 2.1 time: 0.198108 Jul 31 20:03:29.683939 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 285/567] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:29 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1676 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:03:29.698686 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1029889051", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "758cb11a-528c-4227-88a9-030f838941a5"}], "security_groups": [{"name": "tempest-securitygroup--2095407728"}], "key_name": "tempest-keypair-571855253", "user_data": "}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:29.810092 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] validate_networks() for [('758cb11a-528c-4227-88a9-030f838941a5', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:03:30.195573 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:03:30.195965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:03:30.196831 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:03:30.198448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:03:30.198872 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:03:30.208225 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:30.208698 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:30.209512 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:30.209939 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:30.228558 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for project 2f435e60769a43deb3c15b351f97d62c. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:03:30.232584 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for user 76b9c24c8dc94af8b2c8e44be8494e9b and project 2f435e60769a43deb3c15b351f97d62c. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:03:30.234960 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:DELETE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:30.247080 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:03:30.249459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:03:30.298851 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ebb65280-7d00-4af5-bd39-afb62dc9f653 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.604689 Jul 31 20:03:30.299505 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 283/568] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:03:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:03:30.310360 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-16c77c7f-3358-4989-a343-899afeed119c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:30.311147 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-16c77c7f-3358-4989-a343-899afeed119c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:30.368541 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-16c77c7f-3358-4989-a343-899afeed119c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:30.377969 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-16c77c7f-3358-4989-a343-899afeed119c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1241 microversion: 2.1 time: 0.071483 Jul 31 20:03:30.391009 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 286/569] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:30 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:30.706419 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-02f41af4-beea-452c-a21e-784b26d21a4a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:30.707215 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-02f41af4-beea-452c-a21e-784b26d21a4a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:30.714389 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02f41af4-beea-452c-a21e-784b26d21a4a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:30.714927 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02f41af4-beea-452c-a21e-784b26d21a4a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:30.715774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02f41af4-beea-452c-a21e-784b26d21a4a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:30.716269 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02f41af4-beea-452c-a21e-784b26d21a4a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:30.720644 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:30.860808 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-02f41af4-beea-452c-a21e-784b26d21a4a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:30.868397 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-02f41af4-beea-452c-a21e-784b26d21a4a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1676 microversion: 2.1 time: 0.166419 Jul 31 20:03:30.869788 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 284/570] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:30 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:31.386045 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-a4570cae-253d-4d64-8af1-44383062fe1d req-c5aa501c-2163-4c80-9e35-a552cbc8a6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9564a93e-d735-4c3b-916b-8e6c325e4b86", "tag": "5404fa72-b0c7-496c-a13f-4c664ba48b5c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:31.397869 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a4570cae-253d-4d64-8af1-44383062fe1d req-c5aa501c-2163-4c80-9e35-a552cbc8a6d4 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:31.398300 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a4570cae-253d-4d64-8af1-44383062fe1d req-c5aa501c-2163-4c80-9e35-a552cbc8a6d4 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:31.398591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-39cd3c6c-d2f5-4929-897f-212fbc6140a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:31.399261 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-39cd3c6c-d2f5-4929-897f-212fbc6140a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:31.406313 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39cd3c6c-d2f5-4929-897f-212fbc6140a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:31.406757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39cd3c6c-d2f5-4929-897f-212fbc6140a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:31.407740 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39cd3c6c-d2f5-4929-897f-212fbc6140a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:31.408333 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39cd3c6c-d2f5-4929-897f-212fbc6140a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:31.412042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-a4570cae-253d-4d64-8af1-44383062fe1d req-c5aa501c-2163-4c80-9e35-a552cbc8a6d4 service nova] Creating event network-changed:5404fa72-b0c7-496c-a13f-4c664ba48b5c for instance 9564a93e-d735-4c3b-916b-8e6c325e4b86 on hv-cinder-84984 Jul 31 20:03:31.420201 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-a4570cae-253d-4d64-8af1-44383062fe1d req-c5aa501c-2163-4c80-9e35-a552cbc8a6d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035749 Jul 31 20:03:31.423249 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 287/571] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:31.511561 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-39cd3c6c-d2f5-4929-897f-212fbc6140a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:31.522487 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-39cd3c6c-d2f5-4929-897f-212fbc6140a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1301 microversion: 2.1 time: 0.127997 Jul 31 20:03:31.523323 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 285/572] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:31 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1301 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:03:31.890973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1beb8d4a-d2be-45de-bf66-76eae2b4f38b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:31.891675 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1beb8d4a-d2be-45de-bf66-76eae2b4f38b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:31.898875 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1beb8d4a-d2be-45de-bf66-76eae2b4f38b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:31.899279 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1beb8d4a-d2be-45de-bf66-76eae2b4f38b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:31.900257 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1beb8d4a-d2be-45de-bf66-76eae2b4f38b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:31.900809 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1beb8d4a-d2be-45de-bf66-76eae2b4f38b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:32.223788 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1beb8d4a-d2be-45de-bf66-76eae2b4f38b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:32.234431 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1beb8d4a-d2be-45de-bf66-76eae2b4f38b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1676 microversion: 2.1 time: 0.348261 Jul 31 20:03:32.235060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 288/573] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:31 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1676 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:32.546604 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-578b2ae5-1553-4459-8d30-62148cf0ea2e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:32.547975 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-578b2ae5-1553-4459-8d30-62148cf0ea2e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:32.559627 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-578b2ae5-1553-4459-8d30-62148cf0ea2e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:32.560076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-578b2ae5-1553-4459-8d30-62148cf0ea2e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:32.561183 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-578b2ae5-1553-4459-8d30-62148cf0ea2e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:32.562079 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-578b2ae5-1553-4459-8d30-62148cf0ea2e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:32.818949 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-578b2ae5-1553-4459-8d30-62148cf0ea2e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:32.828467 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-578b2ae5-1553-4459-8d30-62148cf0ea2e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1367 microversion: 2.1 time: 0.288426 Jul 31 20:03:32.829068 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 286/574] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:32 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:33.256191 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-57a6823d-b8db-4bc6-84ee-d2d80b4322e4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:33.256772 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-57a6823d-b8db-4bc6-84ee-d2d80b4322e4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:33.263787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57a6823d-b8db-4bc6-84ee-d2d80b4322e4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:33.264220 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57a6823d-b8db-4bc6-84ee-d2d80b4322e4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:33.264979 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57a6823d-b8db-4bc6-84ee-d2d80b4322e4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:33.265470 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57a6823d-b8db-4bc6-84ee-d2d80b4322e4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:33.323273 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-27363a26-6a7f-4a7e-b4a5-61a0a17fa39d req-6c0c1ed4-7a1d-410b-81b7-1c9c14f961e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30cd600-cded-49be-97de-e78bdff544b8", "tag": "70036d21-e25e-49e4-a7f8-df2a7a0f556d"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:33.336479 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-27363a26-6a7f-4a7e-b4a5-61a0a17fa39d req-6c0c1ed4-7a1d-410b-81b7-1c9c14f961e2 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:33.336920 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-27363a26-6a7f-4a7e-b4a5-61a0a17fa39d req-6c0c1ed4-7a1d-410b-81b7-1c9c14f961e2 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:33.349029 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-27363a26-6a7f-4a7e-b4a5-61a0a17fa39d req-6c0c1ed4-7a1d-410b-81b7-1c9c14f961e2 service nova] Creating event network-changed:70036d21-e25e-49e4-a7f8-df2a7a0f556d for instance e30cd600-cded-49be-97de-e78bdff544b8 on hv-cinder-84984 Jul 31 20:03:33.354708 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-27363a26-6a7f-4a7e-b4a5-61a0a17fa39d req-6c0c1ed4-7a1d-410b-81b7-1c9c14f961e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035219 Jul 31 20:03:33.355792 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 287/575] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:03:33.473926 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-57a6823d-b8db-4bc6-84ee-d2d80b4322e4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:33.481997 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-57a6823d-b8db-4bc6-84ee-d2d80b4322e4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1676 microversion: 2.1 time: 0.229593 Jul 31 20:03:33.482538 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 289/576] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:33 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:33.856709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-80d86685-1298-4013-84d5-fff01d2b6c59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:33.858357 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-80d86685-1298-4013-84d5-fff01d2b6c59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:33.871790 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-80d86685-1298-4013-84d5-fff01d2b6c59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:33.872537 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-80d86685-1298-4013-84d5-fff01d2b6c59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:33.873761 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-80d86685-1298-4013-84d5-fff01d2b6c59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:33.874255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-80d86685-1298-4013-84d5-fff01d2b6c59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:34.042787 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-80d86685-1298-4013-84d5-fff01d2b6c59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:34.051468 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-80d86685-1298-4013-84d5-fff01d2b6c59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1367 microversion: 2.1 time: 0.203448 Jul 31 20:03:34.052052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 288/577] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:33 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:34.505412 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-94a59c1e-940b-4112-aa0f-97939fbf7c3f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:34.506017 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-94a59c1e-940b-4112-aa0f-97939fbf7c3f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:34.513204 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94a59c1e-940b-4112-aa0f-97939fbf7c3f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:34.513674 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94a59c1e-940b-4112-aa0f-97939fbf7c3f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:34.514431 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94a59c1e-940b-4112-aa0f-97939fbf7c3f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:34.514861 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94a59c1e-940b-4112-aa0f-97939fbf7c3f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:34.649051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-94a59c1e-940b-4112-aa0f-97939fbf7c3f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:34.651410 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:34.658926 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-94a59c1e-940b-4112-aa0f-97939fbf7c3f tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1676 microversion: 2.1 time: 0.157314 Jul 31 20:03:34.659476 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 290/578] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:34 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:35.001661 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-242eccf3-c234-419d-89c0-4795646ffc17 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d830e84-2e18-42a1-9127-ee501a5883c3"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:35.003923 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-242eccf3-c234-419d-89c0-4795646ffc17 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:35.010946 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-242eccf3-c234-419d-89c0-4795646ffc17 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:35.011398 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-242eccf3-c234-419d-89c0-4795646ffc17 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:35.012156 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-242eccf3-c234-419d-89c0-4795646ffc17 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:35.012586 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-242eccf3-c234-419d-89c0-4795646ffc17 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:35.071919 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-11834900-3e4c-475a-a033-bb5d61a4430c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:35.072526 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-11834900-3e4c-475a-a033-bb5d61a4430c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:35.080344 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11834900-3e4c-475a-a033-bb5d61a4430c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:35.080790 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11834900-3e4c-475a-a033-bb5d61a4430c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:35.081585 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11834900-3e4c-475a-a033-bb5d61a4430c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:35.082013 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11834900-3e4c-475a-a033-bb5d61a4430c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:35.215207 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-11834900-3e4c-475a-a033-bb5d61a4430c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:35.222801 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-11834900-3e4c-475a-a033-bb5d61a4430c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1367 microversion: 2.1 time: 0.154766 Jul 31 20:03:35.223357 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 291/579] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:35 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:35.680458 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5659fd4a-c609-4f41-ae51-cf6acceeb15d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:35.681172 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5659fd4a-c609-4f41-ae51-cf6acceeb15d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:35.688134 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5659fd4a-c609-4f41-ae51-cf6acceeb15d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:35.688605 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5659fd4a-c609-4f41-ae51-cf6acceeb15d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:35.689409 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5659fd4a-c609-4f41-ae51-cf6acceeb15d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:35.689842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5659fd4a-c609-4f41-ae51-cf6acceeb15d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:35.824514 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5659fd4a-c609-4f41-ae51-cf6acceeb15d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:35.836289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5659fd4a-c609-4f41-ae51-cf6acceeb15d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1653 microversion: 2.1 time: 0.159731 Jul 31 20:03:35.837022 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 292/580] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:35 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1653 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:35.856779 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ed7ebb51-1c3b-404a-9aa5-e75768ea56e4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:35.862970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed7ebb51-1c3b-404a-9aa5-e75768ea56e4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:35.863436 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed7ebb51-1c3b-404a-9aa5-e75768ea56e4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:35.885976 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ed7ebb51-1c3b-404a-9aa5-e75768ea56e4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Going to try to start instance {{(pid=117920) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 31 20:03:35.930970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ed7ebb51-1c3b-404a-9aa5-e75768ea56e4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "POST /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/action" status: 202 len: 0 microversion: 2.1 time: 0.077632 Jul 31 20:03:35.931551 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 293/581] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:03:35 2022] POST /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:03:35.939726 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-db5e10b7-2631-496e-82fb-18dbaaf2f0f9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:35.940401 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-db5e10b7-2631-496e-82fb-18dbaaf2f0f9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:35.946385 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db5e10b7-2631-496e-82fb-18dbaaf2f0f9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:35.946852 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db5e10b7-2631-496e-82fb-18dbaaf2f0f9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:35.947591 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db5e10b7-2631-496e-82fb-18dbaaf2f0f9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:35.948010 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db5e10b7-2631-496e-82fb-18dbaaf2f0f9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:36.085813 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-db5e10b7-2631-496e-82fb-18dbaaf2f0f9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:36.093631 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-db5e10b7-2631-496e-82fb-18dbaaf2f0f9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1662 microversion: 2.1 time: 0.157792 Jul 31 20:03:36.094203 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 294/582] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:35 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:36.243460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-867b44a1-9489-4864-8d46-91aa9a0232c5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:36.244057 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-867b44a1-9489-4864-8d46-91aa9a0232c5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:36.250520 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-867b44a1-9489-4864-8d46-91aa9a0232c5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:36.251067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-867b44a1-9489-4864-8d46-91aa9a0232c5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:36.251848 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-867b44a1-9489-4864-8d46-91aa9a0232c5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:36.252283 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-867b44a1-9489-4864-8d46-91aa9a0232c5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:36.291192 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-242eccf3-c234-419d-89c0-4795646ffc17 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "POST /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.294672 Jul 31 20:03:36.297249 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 289/583] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:03:34 2022] POST /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments => generated 194 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:36.383738 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-867b44a1-9489-4864-8d46-91aa9a0232c5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:36.391357 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-867b44a1-9489-4864-8d46-91aa9a0232c5 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1367 microversion: 2.1 time: 0.151793 Jul 31 20:03:36.391917 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 295/584] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:36 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:03:36.961590 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-260ff7a7-c540-48d0-9093-5e5399eaf149 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:36.962280 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-260ff7a7-c540-48d0-9093-5e5399eaf149 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:36.974695 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-260ff7a7-c540-48d0-9093-5e5399eaf149 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:36.975247 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-260ff7a7-c540-48d0-9093-5e5399eaf149 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:36.976092 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-260ff7a7-c540-48d0-9093-5e5399eaf149 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:36.976589 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-260ff7a7-c540-48d0-9093-5e5399eaf149 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:37.115450 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4956d405-2e74-41d8-8ea5-9b1860525682 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:37.116706 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4956d405-2e74-41d8-8ea5-9b1860525682 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:37.124297 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4956d405-2e74-41d8-8ea5-9b1860525682 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:37.124890 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4956d405-2e74-41d8-8ea5-9b1860525682 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:37.125981 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4956d405-2e74-41d8-8ea5-9b1860525682 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:37.126352 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4956d405-2e74-41d8-8ea5-9b1860525682 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:37.537624 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4956d405-2e74-41d8-8ea5-9b1860525682 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:37.545387 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4956d405-2e74-41d8-8ea5-9b1860525682 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1662 microversion: 2.1 time: 0.434138 Jul 31 20:03:37.546036 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 296/585] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:37 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1662 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:37.560938 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-260ff7a7-c540-48d0-9093-5e5399eaf149 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:37.564257 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b886c6b6-dd9f-4735-bdc2-587013c500a3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:37.564902 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b886c6b6-dd9f-4735-bdc2-587013c500a3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:37.570166 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-260ff7a7-c540-48d0-9093-5e5399eaf149 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1594 microversion: 2.1 time: 0.613330 Jul 31 20:03:37.571080 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 290/586] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:36 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1594 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:03:37.572411 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b886c6b6-dd9f-4735-bdc2-587013c500a3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:37.572844 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b886c6b6-dd9f-4735-bdc2-587013c500a3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:37.573651 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b886c6b6-dd9f-4735-bdc2-587013c500a3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:37.574082 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b886c6b6-dd9f-4735-bdc2-587013c500a3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:37.792504 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b886c6b6-dd9f-4735-bdc2-587013c500a3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:37.800499 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b886c6b6-dd9f-4735-bdc2-587013c500a3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1367 microversion: 2.1 time: 0.239943 Jul 31 20:03:37.801083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 297/587] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:37 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:38.567212 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-372c9912-6e6a-4e56-874b-53477e306e43 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:38.567899 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-372c9912-6e6a-4e56-874b-53477e306e43 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:38.575463 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-372c9912-6e6a-4e56-874b-53477e306e43 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:38.575942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-372c9912-6e6a-4e56-874b-53477e306e43 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:38.577209 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-372c9912-6e6a-4e56-874b-53477e306e43 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:38.577993 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-372c9912-6e6a-4e56-874b-53477e306e43 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:38.718906 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-372c9912-6e6a-4e56-874b-53477e306e43 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:38.727947 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-372c9912-6e6a-4e56-874b-53477e306e43 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1662 microversion: 2.1 time: 0.164765 Jul 31 20:03:38.728505 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 291/588] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:38 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1662 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:38.821180 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5ca91ae3-b085-47c9-b3d0-125cd22adeca tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:38.822544 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5ca91ae3-b085-47c9-b3d0-125cd22adeca tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:38.829399 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ca91ae3-b085-47c9-b3d0-125cd22adeca tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:38.829770 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ca91ae3-b085-47c9-b3d0-125cd22adeca tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:38.830751 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ca91ae3-b085-47c9-b3d0-125cd22adeca tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:38.831336 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ca91ae3-b085-47c9-b3d0-125cd22adeca tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:38.967942 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5ca91ae3-b085-47c9-b3d0-125cd22adeca tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:38.975829 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5ca91ae3-b085-47c9-b3d0-125cd22adeca tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1367 microversion: 2.1 time: 0.158549 Jul 31 20:03:38.976403 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 298/589] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:38 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:39.553863 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-404a4c16-b6f0-4102-b45c-a19d876bf27d req-86d7a842-18e5-48f2-8c3b-985e0a7f9bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f2c15d-f549-4688-887c-c6ae18ac1b39", "tag": "635c81a2-0f42-4226-ac0b-56a4f733839f"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:39.577730 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-404a4c16-b6f0-4102-b45c-a19d876bf27d req-86d7a842-18e5-48f2-8c3b-985e0a7f9bab service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:39.578865 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-404a4c16-b6f0-4102-b45c-a19d876bf27d req-86d7a842-18e5-48f2-8c3b-985e0a7f9bab service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:39.593526 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-404a4c16-b6f0-4102-b45c-a19d876bf27d req-86d7a842-18e5-48f2-8c3b-985e0a7f9bab service nova] Creating event network-changed:635c81a2-0f42-4226-ac0b-56a4f733839f for instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 on hv-cinder-84984 Jul 31 20:03:39.598605 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-404a4c16-b6f0-4102-b45c-a19d876bf27d req-86d7a842-18e5-48f2-8c3b-985e0a7f9bab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048305 Jul 31 20:03:39.599936 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 292/590] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:39.753529 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5380e1a-a63b-4dff-9ff1-cab06de3f8ea tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:39.754114 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d5380e1a-a63b-4dff-9ff1-cab06de3f8ea tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:39.761513 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5380e1a-a63b-4dff-9ff1-cab06de3f8ea tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:39.762192 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5380e1a-a63b-4dff-9ff1-cab06de3f8ea tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:39.763160 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5380e1a-a63b-4dff-9ff1-cab06de3f8ea tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:39.763595 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5380e1a-a63b-4dff-9ff1-cab06de3f8ea tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:39.997724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-66cdfb80-b3d9-4fa3-b39e-2d42aaf3afa8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:39.998423 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-66cdfb80-b3d9-4fa3-b39e-2d42aaf3afa8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:40.002320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d5380e1a-a63b-4dff-9ff1-cab06de3f8ea tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:40.006215 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66cdfb80-b3d9-4fa3-b39e-2d42aaf3afa8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:40.007005 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66cdfb80-b3d9-4fa3-b39e-2d42aaf3afa8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:40.007699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66cdfb80-b3d9-4fa3-b39e-2d42aaf3afa8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:40.007843 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66cdfb80-b3d9-4fa3-b39e-2d42aaf3afa8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:40.012771 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d5380e1a-a63b-4dff-9ff1-cab06de3f8ea tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1666 microversion: 2.1 time: 0.267933 Jul 31 20:03:40.014444 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 299/591] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:39 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1666 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:40.218574 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:40.240653 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=10 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:40.250306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-66cdfb80-b3d9-4fa3-b39e-2d42aaf3afa8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:40.260312 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-66cdfb80-b3d9-4fa3-b39e-2d42aaf3afa8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1367 microversion: 2.1 time: 0.267090 Jul 31 20:03:40.262202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 293/592] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:39 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:03:40.656362 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d2703064-ec1c-4159-826c-a9d0aded58f6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-540683190"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:40.659612 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d2703064-ec1c-4159-826c-a9d0aded58f6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:40.665981 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:40.672002 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2703064-ec1c-4159-826c-a9d0aded58f6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:40.672594 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2703064-ec1c-4159-826c-a9d0aded58f6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:40.673970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2703064-ec1c-4159-826c-a9d0aded58f6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:40.674586 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2703064-ec1c-4159-826c-a9d0aded58f6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:40.797324 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-13b60d86-6fa9-4bdb-b5d4-a2a2034e5222 req-f8c6fced-8e32-4508-b370-fc6fdadd396a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30cd600-cded-49be-97de-e78bdff544b8", "name": "network-vif-plugged", "status": "completed", "tag": "70036d21-e25e-49e4-a7f8-df2a7a0f556d"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:40.810658 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-13b60d86-6fa9-4bdb-b5d4-a2a2034e5222 req-f8c6fced-8e32-4508-b370-fc6fdadd396a service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:40.811027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-13b60d86-6fa9-4bdb-b5d4-a2a2034e5222 req-f8c6fced-8e32-4508-b370-fc6fdadd396a service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:40.814987 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.network.security_group_api [None req-d2703064-ec1c-4159-826c-a9d0aded58f6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Adding security group f39e97ea-e3c3-4f24-a5f7-e04513ad136d to port 635c81a2-0f42-4226-ac0b-56a4f733839f Jul 31 20:03:40.823162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-13b60d86-6fa9-4bdb-b5d4-a2a2034e5222 req-f8c6fced-8e32-4508-b370-fc6fdadd396a service nova] Creating event network-vif-plugged:70036d21-e25e-49e4-a7f8-df2a7a0f556d for instance e30cd600-cded-49be-97de-e78bdff544b8 on hv-cinder-84984 Jul 31 20:03:40.828694 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-13b60d86-6fa9-4bdb-b5d4-a2a2034e5222 req-f8c6fced-8e32-4508-b370-fc6fdadd396a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035837 Jul 31 20:03:40.829548 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 294/593] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:41.214467 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d2703064-ec1c-4159-826c-a9d0aded58f6 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "POST /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/action" status: 202 len: 0 microversion: 2.1 time: 0.565668 Jul 31 20:03:41.215125 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 300/594] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:03:40 2022] POST /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 20:03:41.223807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9a9c5917-73a3-43cc-97b9-9a5f30e9a6f3 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:41.224502 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9a9c5917-73a3-43cc-97b9-9a5f30e9a6f3 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:41.227895 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-63d26442-65ca-4f4b-841b-edd0e7fd6bf4 req-79683d03-a6b8-4913-927c-89f81773a4fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f2c15d-f549-4688-887c-c6ae18ac1b39", "tag": "635c81a2-0f42-4226-ac0b-56a4f733839f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:41.231337 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a9c5917-73a3-43cc-97b9-9a5f30e9a6f3 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:41.231821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a9c5917-73a3-43cc-97b9-9a5f30e9a6f3 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:41.232591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a9c5917-73a3-43cc-97b9-9a5f30e9a6f3 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:41.233017 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a9c5917-73a3-43cc-97b9-9a5f30e9a6f3 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:41.238595 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-63d26442-65ca-4f4b-841b-edd0e7fd6bf4 req-79683d03-a6b8-4913-927c-89f81773a4fc service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:41.238957 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-63d26442-65ca-4f4b-841b-edd0e7fd6bf4 req-79683d03-a6b8-4913-927c-89f81773a4fc service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:41.259879 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-63d26442-65ca-4f4b-841b-edd0e7fd6bf4 req-79683d03-a6b8-4913-927c-89f81773a4fc service nova] Creating event network-changed:635c81a2-0f42-4226-ac0b-56a4f733839f for instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 on hv-cinder-84984 Jul 31 20:03:41.268776 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-63d26442-65ca-4f4b-841b-edd0e7fd6bf4 req-79683d03-a6b8-4913-927c-89f81773a4fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047406 Jul 31 20:03:41.269942 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 301/595] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:41.284651 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb6459a0-2264-46e2-84c7-95acec3b804c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:41.288258 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb6459a0-2264-46e2-84c7-95acec3b804c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:41.296016 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb6459a0-2264-46e2-84c7-95acec3b804c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:41.296459 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb6459a0-2264-46e2-84c7-95acec3b804c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:41.297387 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb6459a0-2264-46e2-84c7-95acec3b804c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:41.297759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb6459a0-2264-46e2-84c7-95acec3b804c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:41.439668 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9a9c5917-73a3-43cc-97b9-9a5f30e9a6f3 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:41.448584 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9a9c5917-73a3-43cc-97b9-9a5f30e9a6f3 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1758 microversion: 2.1 time: 0.228886 Jul 31 20:03:41.449346 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 295/596] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:41 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1758 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:41.487967 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb6459a0-2264-46e2-84c7-95acec3b804c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:41.496143 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb6459a0-2264-46e2-84c7-95acec3b804c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1367 microversion: 2.1 time: 0.217112 Jul 31 20:03:41.496639 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 302/597] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:41 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:42.518458 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4d6835ca-89e7-415f-a3b7-0cd81f8ab5e9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:42.519065 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4d6835ca-89e7-415f-a3b7-0cd81f8ab5e9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:42.526017 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4d6835ca-89e7-415f-a3b7-0cd81f8ab5e9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:42.526506 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4d6835ca-89e7-415f-a3b7-0cd81f8ab5e9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:42.527596 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4d6835ca-89e7-415f-a3b7-0cd81f8ab5e9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:42.528285 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4d6835ca-89e7-415f-a3b7-0cd81f8ab5e9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:42.663701 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4d6835ca-89e7-415f-a3b7-0cd81f8ab5e9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:42.671566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4d6835ca-89e7-415f-a3b7-0cd81f8ab5e9 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1367 microversion: 2.1 time: 0.157088 Jul 31 20:03:42.672137 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 296/598] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:42 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:43.692244 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4aaf3d2f-afb2-4220-81fd-7f8a26ff03aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:43.692839 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4aaf3d2f-afb2-4220-81fd-7f8a26ff03aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:43.700058 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4aaf3d2f-afb2-4220-81fd-7f8a26ff03aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:43.700510 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4aaf3d2f-afb2-4220-81fd-7f8a26ff03aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:43.701309 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4aaf3d2f-afb2-4220-81fd-7f8a26ff03aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:43.701738 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4aaf3d2f-afb2-4220-81fd-7f8a26ff03aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:43.844528 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4aaf3d2f-afb2-4220-81fd-7f8a26ff03aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:43.852055 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4aaf3d2f-afb2-4220-81fd-7f8a26ff03aa tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1557 microversion: 2.1 time: 0.163749 Jul 31 20:03:43.852588 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 303/599] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:43 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1557 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:43.875830 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-72e1d828-cc6c-4f2e-9dcf-69a4db3bcc7e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:43.876389 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-72e1d828-cc6c-4f2e-9dcf-69a4db3bcc7e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:43.883198 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72e1d828-cc6c-4f2e-9dcf-69a4db3bcc7e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:43.883642 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72e1d828-cc6c-4f2e-9dcf-69a4db3bcc7e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:43.884395 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72e1d828-cc6c-4f2e-9dcf-69a4db3bcc7e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:43.884824 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72e1d828-cc6c-4f2e-9dcf-69a4db3bcc7e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:43.971955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-72e1d828-cc6c-4f2e-9dcf-69a4db3bcc7e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099914 Jul 31 20:03:43.972612 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 297/600] 10.222.0.48 () {58 vars in 1275 bytes} [Sun Jul 31 20:03:43 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:03:44.964921 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e7d97fd7-b662-4708-a1f7-d3ec7de1e336 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:44.967258 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e7d97fd7-b662-4708-a1f7-d3ec7de1e336 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:44.969677 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:44.974765 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7d97fd7-b662-4708-a1f7-d3ec7de1e336 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:44.975204 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7d97fd7-b662-4708-a1f7-d3ec7de1e336 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:44.975961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7d97fd7-b662-4708-a1f7-d3ec7de1e336 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:44.976383 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7d97fd7-b662-4708-a1f7-d3ec7de1e336 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:45.000403 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-e7d97fd7-b662-4708-a1f7-d3ec7de1e336 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lazy-loading 'flavor' on Instance uuid bac54baf-9c5e-4774-be4a-78b89959104f {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:03:45.162014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e7d97fd7-b662-4708-a1f7-d3ec7de1e336 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "POST /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/action" status: 200 len: 32 microversion: 2.1 time: 0.201223 Jul 31 20:03:45.162736 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 304/601] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:03:44 2022] POST /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 20:03:45.172981 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5b1ec89a-b033-44e7-b5d8-0dc6d77284c8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:45.174757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5b1ec89a-b033-44e7-b5d8-0dc6d77284c8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:45.181534 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b1ec89a-b033-44e7-b5d8-0dc6d77284c8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:45.182111 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b1ec89a-b033-44e7-b5d8-0dc6d77284c8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:45.183171 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b1ec89a-b033-44e7-b5d8-0dc6d77284c8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:45.183872 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b1ec89a-b033-44e7-b5d8-0dc6d77284c8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:45.488396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5b1ec89a-b033-44e7-b5d8-0dc6d77284c8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:45.497303 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5b1ec89a-b033-44e7-b5d8-0dc6d77284c8 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.328744 Jul 31 20:03:45.497912 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 298/602] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:45 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:45.548810 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1638dae0-98eb-402e-95b8-d6d60f6d705c req-a167acbb-a418-4ef0-8463-15425b6b9866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30cd600-cded-49be-97de-e78bdff544b8", "tag": "70036d21-e25e-49e4-a7f8-df2a7a0f556d"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:03:45.559723 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1638dae0-98eb-402e-95b8-d6d60f6d705c req-a167acbb-a418-4ef0-8463-15425b6b9866 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:45.560251 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1638dae0-98eb-402e-95b8-d6d60f6d705c req-a167acbb-a418-4ef0-8463-15425b6b9866 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:45.571533 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1638dae0-98eb-402e-95b8-d6d60f6d705c req-a167acbb-a418-4ef0-8463-15425b6b9866 service nova] Creating event network-changed:70036d21-e25e-49e4-a7f8-df2a7a0f556d for instance e30cd600-cded-49be-97de-e78bdff544b8 on hv-cinder-84984 Jul 31 20:03:45.576790 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1638dae0-98eb-402e-95b8-d6d60f6d705c req-a167acbb-a418-4ef0-8463-15425b6b9866 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033248 Jul 31 20:03:45.577681 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 305/603] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:03:46.519858 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f7c8c4f9-0a1f-4b40-8d9d-0ab073638ab6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:46.520587 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f7c8c4f9-0a1f-4b40-8d9d-0ab073638ab6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:46.527985 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7c8c4f9-0a1f-4b40-8d9d-0ab073638ab6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:46.528847 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7c8c4f9-0a1f-4b40-8d9d-0ab073638ab6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:46.529626 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7c8c4f9-0a1f-4b40-8d9d-0ab073638ab6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:46.530056 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7c8c4f9-0a1f-4b40-8d9d-0ab073638ab6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:46.692970 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f7c8c4f9-0a1f-4b40-8d9d-0ab073638ab6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:46.709548 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f7c8c4f9-0a1f-4b40-8d9d-0ab073638ab6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.194070 Jul 31 20:03:46.713200 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 299/604] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:46 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:47.735186 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6650f6bf-90a9-4c09-8e8b-cbaa30d70c8a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:47.736218 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6650f6bf-90a9-4c09-8e8b-cbaa30d70c8a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:47.745855 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6650f6bf-90a9-4c09-8e8b-cbaa30d70c8a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:47.746489 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6650f6bf-90a9-4c09-8e8b-cbaa30d70c8a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:47.747565 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6650f6bf-90a9-4c09-8e8b-cbaa30d70c8a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:47.748179 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6650f6bf-90a9-4c09-8e8b-cbaa30d70c8a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:47.752008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:47.894027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6650f6bf-90a9-4c09-8e8b-cbaa30d70c8a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:47.906176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6650f6bf-90a9-4c09-8e8b-cbaa30d70c8a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.177562 Jul 31 20:03:47.906892 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 306/605] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:47 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:48.930983 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a46c052e-e009-4db2-b75c-bac7753a34d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:48.931843 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a46c052e-e009-4db2-b75c-bac7753a34d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:48.942909 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a46c052e-e009-4db2-b75c-bac7753a34d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:48.943655 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a46c052e-e009-4db2-b75c-bac7753a34d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:48.944898 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a46c052e-e009-4db2-b75c-bac7753a34d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:48.945662 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a46c052e-e009-4db2-b75c-bac7753a34d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:49.082892 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a46c052e-e009-4db2-b75c-bac7753a34d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:49.093830 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a46c052e-e009-4db2-b75c-bac7753a34d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.169205 Jul 31 20:03:49.094604 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 300/606] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:48 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:50.125729 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fe0bb213-94b5-4b33-8339-bc3b31ed68cc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:50.126825 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fe0bb213-94b5-4b33-8339-bc3b31ed68cc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:50.133993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0bb213-94b5-4b33-8339-bc3b31ed68cc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:50.134443 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0bb213-94b5-4b33-8339-bc3b31ed68cc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:50.135216 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0bb213-94b5-4b33-8339-bc3b31ed68cc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:50.135648 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0bb213-94b5-4b33-8339-bc3b31ed68cc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:50.277351 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe0bb213-94b5-4b33-8339-bc3b31ed68cc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:50.285854 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fe0bb213-94b5-4b33-8339-bc3b31ed68cc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.167032 Jul 31 20:03:50.286431 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 307/607] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:50 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:51.311538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7d754b31-f7c9-407b-a95b-2eaaf5f50383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:51.312370 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7d754b31-f7c9-407b-a95b-2eaaf5f50383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:51.320711 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7d754b31-f7c9-407b-a95b-2eaaf5f50383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:51.321176 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7d754b31-f7c9-407b-a95b-2eaaf5f50383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:51.321935 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7d754b31-f7c9-407b-a95b-2eaaf5f50383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:51.322363 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7d754b31-f7c9-407b-a95b-2eaaf5f50383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:51.453202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7d754b31-f7c9-407b-a95b-2eaaf5f50383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:51.456825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:03:51.461750 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7d754b31-f7c9-407b-a95b-2eaaf5f50383 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.156947 Jul 31 20:03:51.462324 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 301/608] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:51 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:52.487621 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e3d62815-ab5f-4db0-b8fc-f42f6f8a78ed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:52.488192 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3d62815-ab5f-4db0-b8fc-f42f6f8a78ed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:52.495703 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d62815-ab5f-4db0-b8fc-f42f6f8a78ed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:52.496143 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d62815-ab5f-4db0-b8fc-f42f6f8a78ed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:52.496887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d62815-ab5f-4db0-b8fc-f42f6f8a78ed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:52.497352 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d62815-ab5f-4db0-b8fc-f42f6f8a78ed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:52.642350 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3d62815-ab5f-4db0-b8fc-f42f6f8a78ed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:52.650776 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e3d62815-ab5f-4db0-b8fc-f42f6f8a78ed tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.169811 Jul 31 20:03:52.651315 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 308/609] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:52 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:53.672112 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bbedd53e-2b21-45dc-8bc7-2ed3721c7ab5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:53.672659 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bbedd53e-2b21-45dc-8bc7-2ed3721c7ab5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:53.680265 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bbedd53e-2b21-45dc-8bc7-2ed3721c7ab5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:53.680706 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bbedd53e-2b21-45dc-8bc7-2ed3721c7ab5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:53.681472 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bbedd53e-2b21-45dc-8bc7-2ed3721c7ab5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:53.681902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bbedd53e-2b21-45dc-8bc7-2ed3721c7ab5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:53.814182 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bbedd53e-2b21-45dc-8bc7-2ed3721c7ab5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:53.826637 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bbedd53e-2b21-45dc-8bc7-2ed3721c7ab5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.158255 Jul 31 20:03:53.827394 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 302/610] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:53 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:54.854168 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2db2653e-2c93-455e-bada-5b76f4758ddf tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:54.855080 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2db2653e-2c93-455e-bada-5b76f4758ddf tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:54.866980 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2db2653e-2c93-455e-bada-5b76f4758ddf tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:54.867728 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2db2653e-2c93-455e-bada-5b76f4758ddf tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:54.868983 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2db2653e-2c93-455e-bada-5b76f4758ddf tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:54.870119 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2db2653e-2c93-455e-bada-5b76f4758ddf tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:55.009198 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2db2653e-2c93-455e-bada-5b76f4758ddf tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:55.017553 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2db2653e-2c93-455e-bada-5b76f4758ddf tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.169980 Jul 31 20:03:55.018127 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 309/611] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:54 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:56.040165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0daf7d5c-dcfc-4da4-89a9-26f279520a69 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:56.040833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0daf7d5c-dcfc-4da4-89a9-26f279520a69 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:56.048206 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0daf7d5c-dcfc-4da4-89a9-26f279520a69 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:56.048730 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0daf7d5c-dcfc-4da4-89a9-26f279520a69 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:56.049602 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0daf7d5c-dcfc-4da4-89a9-26f279520a69 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:56.050099 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0daf7d5c-dcfc-4da4-89a9-26f279520a69 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:56.186984 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0daf7d5c-dcfc-4da4-89a9-26f279520a69 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:56.195562 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0daf7d5c-dcfc-4da4-89a9-26f279520a69 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.159749 Jul 31 20:03:56.196159 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 303/612] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:56 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:57.220551 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a80b06d6-8333-40f8-8160-1a79ed318954 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:57.221450 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a80b06d6-8333-40f8-8160-1a79ed318954 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:57.229204 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a80b06d6-8333-40f8-8160-1a79ed318954 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:57.229679 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a80b06d6-8333-40f8-8160-1a79ed318954 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:57.230435 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a80b06d6-8333-40f8-8160-1a79ed318954 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:57.230861 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a80b06d6-8333-40f8-8160-1a79ed318954 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:57.364081 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a80b06d6-8333-40f8-8160-1a79ed318954 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:57.373004 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a80b06d6-8333-40f8-8160-1a79ed318954 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.158985 Jul 31 20:03:57.373602 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 310/613] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:57 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:58.397755 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a65fd2b6-4d0e-415a-9225-fd5af233053e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:58.398356 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a65fd2b6-4d0e-415a-9225-fd5af233053e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:58.406181 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a65fd2b6-4d0e-415a-9225-fd5af233053e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:58.406688 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a65fd2b6-4d0e-415a-9225-fd5af233053e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:58.407538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a65fd2b6-4d0e-415a-9225-fd5af233053e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:58.408021 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a65fd2b6-4d0e-415a-9225-fd5af233053e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:58.554245 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a65fd2b6-4d0e-415a-9225-fd5af233053e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:58.567710 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a65fd2b6-4d0e-415a-9225-fd5af233053e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.175808 Jul 31 20:03:58.568274 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 304/614] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:58 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:03:59.595322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4fcc9a97-9c32-4fa6-b608-f2c34c44bdf5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:03:59.596223 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4fcc9a97-9c32-4fa6-b608-f2c34c44bdf5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:03:59.603559 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fcc9a97-9c32-4fa6-b608-f2c34c44bdf5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:59.604004 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fcc9a97-9c32-4fa6-b608-f2c34c44bdf5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:59.604748 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fcc9a97-9c32-4fa6-b608-f2c34c44bdf5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:03:59.605183 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fcc9a97-9c32-4fa6-b608-f2c34c44bdf5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:03:59.740734 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4fcc9a97-9c32-4fa6-b608-f2c34c44bdf5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:03:59.749532 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4fcc9a97-9c32-4fa6-b608-f2c34c44bdf5 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.160739 Jul 31 20:03:59.750069 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 311/615] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:03:59 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:00.775194 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5d39c45b-578d-40e2-b8ce-887de3ca4736 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:00.776161 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5d39c45b-578d-40e2-b8ce-887de3ca4736 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:00.779829 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:00.787669 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d39c45b-578d-40e2-b8ce-887de3ca4736 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:00.788127 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d39c45b-578d-40e2-b8ce-887de3ca4736 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:00.788874 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d39c45b-578d-40e2-b8ce-887de3ca4736 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:00.789318 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d39c45b-578d-40e2-b8ce-887de3ca4736 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:00.937547 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5d39c45b-578d-40e2-b8ce-887de3ca4736 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:00.945769 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5d39c45b-578d-40e2-b8ce-887de3ca4736 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.177579 Jul 31 20:04:00.946334 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 305/616] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:00 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:01.971038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-96cc161f-2e0c-4432-8fc1-56b009fce38c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:01.971882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-96cc161f-2e0c-4432-8fc1-56b009fce38c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:01.983045 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96cc161f-2e0c-4432-8fc1-56b009fce38c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:01.983785 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96cc161f-2e0c-4432-8fc1-56b009fce38c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:01.985038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96cc161f-2e0c-4432-8fc1-56b009fce38c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:01.985797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96cc161f-2e0c-4432-8fc1-56b009fce38c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:02.117956 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96cc161f-2e0c-4432-8fc1-56b009fce38c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:02.130623 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-96cc161f-2e0c-4432-8fc1-56b009fce38c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.165964 Jul 31 20:04:02.131510 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 312/617] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:01 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:03.156609 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4fb0de3d-16b5-4c0f-a409-d09ae9219ec9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:03.158545 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4fb0de3d-16b5-4c0f-a409-d09ae9219ec9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:03.166737 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4fb0de3d-16b5-4c0f-a409-d09ae9219ec9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:03.167174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4fb0de3d-16b5-4c0f-a409-d09ae9219ec9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:03.167936 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4fb0de3d-16b5-4c0f-a409-d09ae9219ec9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:03.168361 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4fb0de3d-16b5-4c0f-a409-d09ae9219ec9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:03.313738 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4fb0de3d-16b5-4c0f-a409-d09ae9219ec9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:03.322007 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4fb0de3d-16b5-4c0f-a409-d09ae9219ec9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.172331 Jul 31 20:04:03.322579 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 306/618] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:03 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:04.347709 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dcd6c64d-307c-479b-91ac-6d53b0e65843 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:04.348630 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dcd6c64d-307c-479b-91ac-6d53b0e65843 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:04.359801 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcd6c64d-307c-479b-91ac-6d53b0e65843 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:04.360538 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcd6c64d-307c-479b-91ac-6d53b0e65843 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:04.361886 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcd6c64d-307c-479b-91ac-6d53b0e65843 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:04.362605 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcd6c64d-307c-479b-91ac-6d53b0e65843 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:04.502743 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dcd6c64d-307c-479b-91ac-6d53b0e65843 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:04.512282 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dcd6c64d-307c-479b-91ac-6d53b0e65843 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1738 microversion: 2.1 time: 0.171182 Jul 31 20:04:04.512857 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 313/619] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:04 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:05.534284 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-58dcb0c4-f7de-4fc7-a2d8-de5098f6823a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:05.535008 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-58dcb0c4-f7de-4fc7-a2d8-de5098f6823a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:05.541830 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58dcb0c4-f7de-4fc7-a2d8-de5098f6823a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:05.542297 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58dcb0c4-f7de-4fc7-a2d8-de5098f6823a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:05.543036 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58dcb0c4-f7de-4fc7-a2d8-de5098f6823a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:05.543470 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58dcb0c4-f7de-4fc7-a2d8-de5098f6823a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:05.692398 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-58dcb0c4-f7de-4fc7-a2d8-de5098f6823a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:05.706847 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-58dcb0c4-f7de-4fc7-a2d8-de5098f6823a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1718 microversion: 2.1 time: 0.176485 Jul 31 20:04:05.707877 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 307/620] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:05 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1718 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:05.831738 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3c19d6ae-ecd4-47fb-88d8-d9ae5cdce8dc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:05.832602 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3c19d6ae-ecd4-47fb-88d8-d9ae5cdce8dc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:05.839995 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c19d6ae-ecd4-47fb-88d8-d9ae5cdce8dc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:05.840438 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c19d6ae-ecd4-47fb-88d8-d9ae5cdce8dc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:05.841206 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c19d6ae-ecd4-47fb-88d8-d9ae5cdce8dc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:05.841663 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c19d6ae-ecd4-47fb-88d8-d9ae5cdce8dc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:05.924693 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-3c19d6ae-ecd4-47fb-88d8-d9ae5cdce8dc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] HTTP exception thrown: Cannot 'detach_volume' instance bac54baf-9c5e-4774-be4a-78b89959104f while it is in vm_state rescued Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3c19d6ae-ecd4-47fb-88d8-d9ae5cdce8dc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Request method failure captured: Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments/7d830e84-2e18-42a1-9127-ee501a5883c3 HTTP/1.1 Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8wkAlbXsas087082cheCywlugC2lHFFc9iVqgo6_sBsR-YY5pZu5t-1nBKYhilL82c6N8gE1zCXnBGzizSkvsRiCQKIGfA7AeTxya_nSNWYEfiyYJL4ENUjFdbfKAqnXJ6B5iGF_OvnduRT1jdq2eFQLBjV9thklPR9a7cgSgtG9I Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 41f4d4561f4f40f8b370b8cc943c97af Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:04:05.926472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:04:05.928158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/41f4d4561f4f40f8b370b8cc943c97af"}]}] Jul 31 20:04:05.928158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:04:05.928158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 41f4d4561f4f40f8b370b8cc943c97af Jul 31 20:04:05.928158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:04:05.928158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-154903434-project Jul 31 20:04:05.928158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:04:05.928158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:04:05.928158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 89abc5820b584315a8413f6402f7ff1f Jul 31 20:04:05.928158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-154903434-project Jul 31 20:04:05.928158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:04:05.928158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Cannot 'detach_volume' instance bac54baf-9c5e-4774-be4a-78b89959104f while it is in vm_state rescued Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'server_id': 'bac54baf-9c5e-4774-be4a-78b89959104f', 'id': '7d830e84-2e18-42a1-9127-ee501a5883c3'} Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bac54baf-9c5e-4774-be4a-78b89959104f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:04:05.929850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bac54baf-9c5e-4774-be4a-78b89959104f while it is in vm_state rescued Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bac54baf-9c5e-4774-be4a-78b89959104f while it is in vm_state rescued Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:04:05.931320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3c19d6ae-ecd4-47fb-88d8-d9ae5cdce8dc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Returning 409 to user: Cannot 'detach_volume' instance bac54baf-9c5e-4774-be4a-78b89959104f while it is in vm_state rescued {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:04:05.932407 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3c19d6ae-ecd4-47fb-88d8-d9ae5cdce8dc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments/7d830e84-2e18-42a1-9127-ee501a5883c3" status: 409 len: 152 microversion: 2.1 time: 0.102827 Jul 31 20:04:05.932407 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 314/621] 10.222.0.48 () {58 vars in 1416 bytes} [Sun Jul 31 20:04:05 2022] DELETE /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments/7d830e84-2e18-42a1-9127-ee501a5883c3 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 20:04:05.937025 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-eebbc29f-d3b9-4f97-8e0d-fbae30047733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:05.937581 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-eebbc29f-d3b9-4f97-8e0d-fbae30047733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:05.943942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eebbc29f-d3b9-4f97-8e0d-fbae30047733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:05.944375 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eebbc29f-d3b9-4f97-8e0d-fbae30047733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:05.945123 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eebbc29f-d3b9-4f97-8e0d-fbae30047733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:05.945661 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eebbc29f-d3b9-4f97-8e0d-fbae30047733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:06.014155 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-eebbc29f-d3b9-4f97-8e0d-fbae30047733 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "POST /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/action" status: 202 len: 0 microversion: 2.1 time: 0.080854 Jul 31 20:04:06.015425 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 308/622] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:04:05 2022] POST /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:04:06.023897 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-07d3b439-7ff1-4682-8193-bfede7bb4499 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:06.024970 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-07d3b439-7ff1-4682-8193-bfede7bb4499 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:06.033844 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07d3b439-7ff1-4682-8193-bfede7bb4499 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:06.034270 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07d3b439-7ff1-4682-8193-bfede7bb4499 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:06.035060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07d3b439-7ff1-4682-8193-bfede7bb4499 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:06.035517 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07d3b439-7ff1-4682-8193-bfede7bb4499 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:06.256794 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-07d3b439-7ff1-4682-8193-bfede7bb4499 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:06.265024 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-07d3b439-7ff1-4682-8193-bfede7bb4499 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1726 microversion: 2.1 time: 0.245382 Jul 31 20:04:06.265598 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 315/623] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:06 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1726 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:07.291219 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0666449b-576e-4ed2-b564-add762668d00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:07.292316 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0666449b-576e-4ed2-b564-add762668d00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:07.302035 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0666449b-576e-4ed2-b564-add762668d00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:07.302472 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0666449b-576e-4ed2-b564-add762668d00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:07.303223 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0666449b-576e-4ed2-b564-add762668d00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:07.303654 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0666449b-576e-4ed2-b564-add762668d00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:07.444984 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0666449b-576e-4ed2-b564-add762668d00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:07.453565 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0666449b-576e-4ed2-b564-add762668d00 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1726 microversion: 2.1 time: 0.169743 Jul 31 20:04:07.454133 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 309/624] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:07 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:08.477443 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3b5828d2-91a5-49ce-a24d-7caf46aea6fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:08.478012 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3b5828d2-91a5-49ce-a24d-7caf46aea6fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:08.485378 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b5828d2-91a5-49ce-a24d-7caf46aea6fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:08.485847 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b5828d2-91a5-49ce-a24d-7caf46aea6fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:08.486648 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b5828d2-91a5-49ce-a24d-7caf46aea6fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:08.487094 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b5828d2-91a5-49ce-a24d-7caf46aea6fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:08.621826 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b5828d2-91a5-49ce-a24d-7caf46aea6fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:08.635204 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3b5828d2-91a5-49ce-a24d-7caf46aea6fc tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1726 microversion: 2.1 time: 0.162139 Jul 31 20:04:08.636039 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 316/625] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:08 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:09.660297 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d16001eb-cc35-478c-aecf-653e21e42eff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:09.660938 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d16001eb-cc35-478c-aecf-653e21e42eff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:09.667717 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d16001eb-cc35-478c-aecf-653e21e42eff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:09.668157 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d16001eb-cc35-478c-aecf-653e21e42eff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:09.668906 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d16001eb-cc35-478c-aecf-653e21e42eff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:09.669369 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d16001eb-cc35-478c-aecf-653e21e42eff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:09.804621 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d16001eb-cc35-478c-aecf-653e21e42eff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:09.813396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d16001eb-cc35-478c-aecf-653e21e42eff tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1726 microversion: 2.1 time: 0.157125 Jul 31 20:04:09.813963 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 310/626] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:09 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:10.836850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-905b4b65-3ada-4f21-aafc-2349a6de1ec1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:10.837506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-905b4b65-3ada-4f21-aafc-2349a6de1ec1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:10.844876 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-905b4b65-3ada-4f21-aafc-2349a6de1ec1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:10.845352 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-905b4b65-3ada-4f21-aafc-2349a6de1ec1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:10.846105 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-905b4b65-3ada-4f21-aafc-2349a6de1ec1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:10.846525 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-905b4b65-3ada-4f21-aafc-2349a6de1ec1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:10.993455 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-905b4b65-3ada-4f21-aafc-2349a6de1ec1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:11.002139 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-905b4b65-3ada-4f21-aafc-2349a6de1ec1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1732 microversion: 2.1 time: 0.169156 Jul 31 20:04:11.002713 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 317/627] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:10 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:11.028851 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a96329ac-ced0-47bd-9c4c-3d3f800822f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:11.029452 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a96329ac-ced0-47bd-9c4c-3d3f800822f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:11.036200 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a96329ac-ced0-47bd-9c4c-3d3f800822f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:11.036681 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a96329ac-ced0-47bd-9c4c-3d3f800822f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:11.037484 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a96329ac-ced0-47bd-9c4c-3d3f800822f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:11.037913 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a96329ac-ced0-47bd-9c4c-3d3f800822f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:11.116128 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a96329ac-ced0-47bd-9c4c-3d3f800822f2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090871 Jul 31 20:04:11.116905 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 311/628] 10.222.0.48 () {58 vars in 1275 bytes} [Sun Jul 31 20:04:11 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:12.016290 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-9cc94e72-2779-48e0-a187-b2f5aafcd449 req-9fc3ea1d-0842-4384-a91c-1a6d212132c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac54baf-9c5e-4774-be4a-78b89959104f", "tag": "4b015db4-1121-4b9d-8f46-45643ea431bf"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:12.027323 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9cc94e72-2779-48e0-a187-b2f5aafcd449 req-9fc3ea1d-0842-4384-a91c-1a6d212132c8 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:12.032654 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9cc94e72-2779-48e0-a187-b2f5aafcd449 req-9fc3ea1d-0842-4384-a91c-1a6d212132c8 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:12.051270 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-9cc94e72-2779-48e0-a187-b2f5aafcd449 req-9fc3ea1d-0842-4384-a91c-1a6d212132c8 service nova] Creating event network-changed:4b015db4-1121-4b9d-8f46-45643ea431bf for instance bac54baf-9c5e-4774-be4a-78b89959104f on hv-cinder-84984 Jul 31 20:04:12.056497 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-9cc94e72-2779-48e0-a187-b2f5aafcd449 req-9fc3ea1d-0842-4384-a91c-1a6d212132c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044066 Jul 31 20:04:12.057350 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 318/629] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:14.072141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-00483d4d-c3e9-44af-94e6-4c78098ce554 req-246b4f56-a1f7-48bc-9fc5-24e370c36690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac54baf-9c5e-4774-be4a-78b89959104f", "tag": "4b015db4-1121-4b9d-8f46-45643ea431bf"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:14.082396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-00483d4d-c3e9-44af-94e6-4c78098ce554 req-246b4f56-a1f7-48bc-9fc5-24e370c36690 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:14.082834 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-00483d4d-c3e9-44af-94e6-4c78098ce554 req-246b4f56-a1f7-48bc-9fc5-24e370c36690 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:14.094424 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-00483d4d-c3e9-44af-94e6-4c78098ce554 req-246b4f56-a1f7-48bc-9fc5-24e370c36690 service nova] Creating event network-changed:4b015db4-1121-4b9d-8f46-45643ea431bf for instance bac54baf-9c5e-4774-be4a-78b89959104f on hv-cinder-84984 Jul 31 20:04:14.099575 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-00483d4d-c3e9-44af-94e6-4c78098ce554 req-246b4f56-a1f7-48bc-9fc5-24e370c36690 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031829 Jul 31 20:04:14.100154 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 312/630] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:14.670372 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4f27990c-9d30-448b-9f5d-120bd13c1406 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:14.672858 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4f27990c-9d30-448b-9f5d-120bd13c1406 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:14.680227 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f27990c-9d30-448b-9f5d-120bd13c1406 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:14.680828 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f27990c-9d30-448b-9f5d-120bd13c1406 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:14.681866 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f27990c-9d30-448b-9f5d-120bd13c1406 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:14.682374 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f27990c-9d30-448b-9f5d-120bd13c1406 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:14.760754 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4f27990c-9d30-448b-9f5d-120bd13c1406 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "POST /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/action" status: 202 len: 0 microversion: 2.1 time: 0.094512 Jul 31 20:04:14.762359 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 319/631] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:04:14 2022] POST /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:04:14.770694 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5a904435-459d-42ce-bbd4-71b4c73f2370 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:14.771384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5a904435-459d-42ce-bbd4-71b4c73f2370 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:14.777890 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a904435-459d-42ce-bbd4-71b4c73f2370 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:14.778333 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a904435-459d-42ce-bbd4-71b4c73f2370 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:14.779091 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a904435-459d-42ce-bbd4-71b4c73f2370 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:14.779503 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a904435-459d-42ce-bbd4-71b4c73f2370 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:14.970427 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5a904435-459d-42ce-bbd4-71b4c73f2370 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:14.978966 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5a904435-459d-42ce-bbd4-71b4c73f2370 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1750 microversion: 2.1 time: 0.212512 Jul 31 20:04:14.979508 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 313/632] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:14 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1750 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:04:15.082644 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e0cbee40-0480-4c99-aebc-72ccef03cc27 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:15.083219 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e0cbee40-0480-4c99-aebc-72ccef03cc27 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:15.085192 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=32 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:15.090774 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0cbee40-0480-4c99-aebc-72ccef03cc27 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:15.091220 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0cbee40-0480-4c99-aebc-72ccef03cc27 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:15.092022 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0cbee40-0480-4c99-aebc-72ccef03cc27 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:15.092451 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0cbee40-0480-4c99-aebc-72ccef03cc27 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:15.122910 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e0cbee40-0480-4c99-aebc-72ccef03cc27 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-volume_attachments/84187333-84b3-4887-8b53-a368217d525e" status: 200 len: 194 microversion: 2.20 time: 0.044632 Jul 31 20:04:15.123888 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 320/633] 10.222.0.48 () {60 vars in 1454 bytes} [Sun Jul 31 20:04:15 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-volume_attachments/84187333-84b3-4887-8b53-a368217d525e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 20:04:15.191799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7589e9ce-70a0-4664-bce7-07292ba1b5f6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:15.192407 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7589e9ce-70a0-4664-bce7-07292ba1b5f6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:15.199262 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7589e9ce-70a0-4664-bce7-07292ba1b5f6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:15.199773 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7589e9ce-70a0-4664-bce7-07292ba1b5f6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:15.200600 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7589e9ce-70a0-4664-bce7-07292ba1b5f6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:15.201087 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7589e9ce-70a0-4664-bce7-07292ba1b5f6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:15.282879 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-7589e9ce-70a0-4664-bce7-07292ba1b5f6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lazy-loading 'services' on Instance uuid cdb0b91c-9a78-49a1-a96b-016c09759655 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:04:15.362750 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7589e9ce-70a0-4664-bce7-07292ba1b5f6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-volume_attachments/84187333-84b3-4887-8b53-a368217d525e" status: 202 len: 0 microversion: 2.20 time: 0.174735 Jul 31 20:04:15.363534 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 314/634] 10.222.0.48 () {60 vars in 1457 bytes} [Sun Jul 31 20:04:15 2022] DELETE /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-volume_attachments/84187333-84b3-4887-8b53-a368217d525e => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:04:15.372987 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-29350cd9-b017-4436-aaa8-e5e57a7536ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:15.375091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-29350cd9-b017-4436-aaa8-e5e57a7536ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:15.382176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29350cd9-b017-4436-aaa8-e5e57a7536ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:15.382794 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29350cd9-b017-4436-aaa8-e5e57a7536ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:15.383739 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29350cd9-b017-4436-aaa8-e5e57a7536ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:15.384231 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29350cd9-b017-4436-aaa8-e5e57a7536ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:15.416312 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-29350cd9-b017-4436-aaa8-e5e57a7536ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047971 Jul 31 20:04:15.417077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 321/635] 10.222.0.48 () {60 vars in 1343 bytes} [Sun Jul 31 20:04:15 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 20:04:16.005610 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e08d3b73-102a-4075-966e-1da708f2e3cf tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:16.006466 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e08d3b73-102a-4075-966e-1da708f2e3cf tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:16.014382 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e08d3b73-102a-4075-966e-1da708f2e3cf tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:16.014896 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e08d3b73-102a-4075-966e-1da708f2e3cf tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:16.015777 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e08d3b73-102a-4075-966e-1da708f2e3cf tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:16.016278 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e08d3b73-102a-4075-966e-1da708f2e3cf tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:16.163116 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e08d3b73-102a-4075-966e-1da708f2e3cf tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:16.171253 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e08d3b73-102a-4075-966e-1da708f2e3cf tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.172869 Jul 31 20:04:16.171827 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 315/636] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:15 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:16.429855 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0a148f90-a3a2-4a9f-a3da-1f39bc052b60 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:16.431871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0a148f90-a3a2-4a9f-a3da-1f39bc052b60 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:16.439150 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a148f90-a3a2-4a9f-a3da-1f39bc052b60 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:16.439587 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a148f90-a3a2-4a9f-a3da-1f39bc052b60 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:16.440343 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a148f90-a3a2-4a9f-a3da-1f39bc052b60 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:16.440766 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a148f90-a3a2-4a9f-a3da-1f39bc052b60 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:16.454925 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:16.472022 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0a148f90-a3a2-4a9f-a3da-1f39bc052b60 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046945 Jul 31 20:04:16.472572 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 322/637] 10.222.0.48 () {60 vars in 1343 bytes} [Sun Jul 31 20:04:16 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 20:04:17.195846 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8cbaea58-f152-4449-87cb-5dbcde0985e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:17.196756 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8cbaea58-f152-4449-87cb-5dbcde0985e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:17.207921 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8cbaea58-f152-4449-87cb-5dbcde0985e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:17.208719 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8cbaea58-f152-4449-87cb-5dbcde0985e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:17.209618 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8cbaea58-f152-4449-87cb-5dbcde0985e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:17.209985 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8cbaea58-f152-4449-87cb-5dbcde0985e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:17.366561 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8cbaea58-f152-4449-87cb-5dbcde0985e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:17.378662 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8cbaea58-f152-4449-87cb-5dbcde0985e2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.189327 Jul 31 20:04:17.379230 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 316/638] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:17 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:17.488940 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-19f429b5-1392-4ee3-87ed-1960ea0cd8b2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:17.492298 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-19f429b5-1392-4ee3-87ed-1960ea0cd8b2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:17.503646 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19f429b5-1392-4ee3-87ed-1960ea0cd8b2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:17.504374 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19f429b5-1392-4ee3-87ed-1960ea0cd8b2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:17.505727 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19f429b5-1392-4ee3-87ed-1960ea0cd8b2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:17.506132 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19f429b5-1392-4ee3-87ed-1960ea0cd8b2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:17.543859 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-19f429b5-1392-4ee3-87ed-1960ea0cd8b2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061600 Jul 31 20:04:17.544376 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 323/639] 10.222.0.48 () {60 vars in 1343 bytes} [Sun Jul 31 20:04:17 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:17.616920 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-eb85866e-5b56-4dfa-b6a7-33a6cb44ea91 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:17.617437 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-eb85866e-5b56-4dfa-b6a7-33a6cb44ea91 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:17.624571 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb85866e-5b56-4dfa-b6a7-33a6cb44ea91 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:17.625022 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb85866e-5b56-4dfa-b6a7-33a6cb44ea91 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:17.625823 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb85866e-5b56-4dfa-b6a7-33a6cb44ea91 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:17.626253 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb85866e-5b56-4dfa-b6a7-33a6cb44ea91 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:17.651200 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-eb85866e-5b56-4dfa-b6a7-33a6cb44ea91 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:04:17.654120 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:17.735711 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-eb85866e-5b56-4dfa-b6a7-33a6cb44ea91 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 204 len: 0 microversion: 2.20 time: 0.123463 Jul 31 20:04:17.736350 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 317/640] 10.222.0.48 () {60 vars in 1280 bytes} [Sun Jul 31 20:04:17 2022] DELETE /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 20:04:17.745324 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a7175405-29b8-49a2-823b-712ddc524bc6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:17.745851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a7175405-29b8-49a2-823b-712ddc524bc6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:17.751935 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7175405-29b8-49a2-823b-712ddc524bc6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:17.752373 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7175405-29b8-49a2-823b-712ddc524bc6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:17.753108 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7175405-29b8-49a2-823b-712ddc524bc6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:17.753598 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7175405-29b8-49a2-823b-712ddc524bc6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:17.896306 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a7175405-29b8-49a2-823b-712ddc524bc6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:17.904573 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a7175405-29b8-49a2-823b-712ddc524bc6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:17.906105 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a7175405-29b8-49a2-823b-712ddc524bc6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:17.907244 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a7175405-29b8-49a2-823b-712ddc524bc6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.166346 Jul 31 20:04:17.907803 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 324/641] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:17 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:04:18.405650 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-57a57545-1b8a-4607-8188-cba830106cc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:18.406722 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-57a57545-1b8a-4607-8188-cba830106cc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:18.418554 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-57a57545-1b8a-4607-8188-cba830106cc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:18.419283 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-57a57545-1b8a-4607-8188-cba830106cc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:18.420527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-57a57545-1b8a-4607-8188-cba830106cc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:18.421284 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-57a57545-1b8a-4607-8188-cba830106cc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:18.573514 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-57a57545-1b8a-4607-8188-cba830106cc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:18.582113 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-57a57545-1b8a-4607-8188-cba830106cc9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.184049 Jul 31 20:04:18.582684 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 318/642] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:18 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:18.935077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-813822dd-d0ab-4a7b-a99b-2df45d39c8df tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:18.936093 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-813822dd-d0ab-4a7b-a99b-2df45d39c8df tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:18.946468 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-813822dd-d0ab-4a7b-a99b-2df45d39c8df tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:18.946912 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-813822dd-d0ab-4a7b-a99b-2df45d39c8df tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:18.947708 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-813822dd-d0ab-4a7b-a99b-2df45d39c8df tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:18.948141 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-813822dd-d0ab-4a7b-a99b-2df45d39c8df tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:19.086320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-813822dd-d0ab-4a7b-a99b-2df45d39c8df tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:19.094482 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-813822dd-d0ab-4a7b-a99b-2df45d39c8df tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:19.096009 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-813822dd-d0ab-4a7b-a99b-2df45d39c8df tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:19.097240 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-813822dd-d0ab-4a7b-a99b-2df45d39c8df tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.168791 Jul 31 20:04:19.097762 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 325/643] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:18 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:04:19.607282 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2e1989c3-c20d-4132-a479-dcd7ad8c29d2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:19.608270 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2e1989c3-c20d-4132-a479-dcd7ad8c29d2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:19.618435 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e1989c3-c20d-4132-a479-dcd7ad8c29d2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:19.618884 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e1989c3-c20d-4132-a479-dcd7ad8c29d2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:19.620011 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e1989c3-c20d-4132-a479-dcd7ad8c29d2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:19.620448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e1989c3-c20d-4132-a479-dcd7ad8c29d2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:19.786403 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2e1989c3-c20d-4132-a479-dcd7ad8c29d2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:19.794982 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2e1989c3-c20d-4132-a479-dcd7ad8c29d2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.194347 Jul 31 20:04:19.795553 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 319/644] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:19 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:20.123186 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c02df845-2051-4ac3-aab1-568c67045c57 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:20.123870 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c02df845-2051-4ac3-aab1-568c67045c57 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:20.133525 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c02df845-2051-4ac3-aab1-568c67045c57 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:20.133974 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c02df845-2051-4ac3-aab1-568c67045c57 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:20.134735 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c02df845-2051-4ac3-aab1-568c67045c57 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:20.135161 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c02df845-2051-4ac3-aab1-568c67045c57 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:20.365029 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c02df845-2051-4ac3-aab1-568c67045c57 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:20.373904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c02df845-2051-4ac3-aab1-568c67045c57 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:20.375393 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c02df845-2051-4ac3-aab1-568c67045c57 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:20.376546 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c02df845-2051-4ac3-aab1-568c67045c57 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1723 microversion: 2.20 time: 0.259131 Jul 31 20:04:20.377113 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 326/645] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:20 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:04:20.817922 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-42756126-bac8-419f-848d-91382e4b15a7 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:20.818622 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-42756126-bac8-419f-848d-91382e4b15a7 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:20.825559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-42756126-bac8-419f-848d-91382e4b15a7 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:20.825983 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-42756126-bac8-419f-848d-91382e4b15a7 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:20.826756 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-42756126-bac8-419f-848d-91382e4b15a7 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:20.827358 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-42756126-bac8-419f-848d-91382e4b15a7 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:21.057553 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-42756126-bac8-419f-848d-91382e4b15a7 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:21.065799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-42756126-bac8-419f-848d-91382e4b15a7 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.251803 Jul 31 20:04:21.066400 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 320/646] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:20 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:21.161776 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-f344d5a5-399b-42ed-99e8-9ed82847b75e req-0e2de4a7-cb9b-4c16-b625-755b2ed50c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb0b91c-9a78-49a1-a96b-016c09759655", "name": "network-vif-deleted", "tag": "eaea7f4e-af98-4acb-9edb-366b7b6e28d8"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:21.174357 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f344d5a5-399b-42ed-99e8-9ed82847b75e req-0e2de4a7-cb9b-4c16-b625-755b2ed50c85 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:21.175320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f344d5a5-399b-42ed-99e8-9ed82847b75e req-0e2de4a7-cb9b-4c16-b625-755b2ed50c85 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:21.188441 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-f344d5a5-399b-42ed-99e8-9ed82847b75e req-0e2de4a7-cb9b-4c16-b625-755b2ed50c85 service nova] Creating event network-vif-deleted:eaea7f4e-af98-4acb-9edb-366b7b6e28d8 for instance cdb0b91c-9a78-49a1-a96b-016c09759655 on hv-cinder-84984 Jul 31 20:04:21.195590 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-f344d5a5-399b-42ed-99e8-9ed82847b75e req-0e2de4a7-cb9b-4c16-b625-755b2ed50c85 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036767 Jul 31 20:04:21.196928 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 327/647] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:21.401045 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-94edd5dd-79b0-4646-b6d6-e56379ad85cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:21.401944 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-94edd5dd-79b0-4646-b6d6-e56379ad85cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:21.408749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94edd5dd-79b0-4646-b6d6-e56379ad85cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:21.409224 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94edd5dd-79b0-4646-b6d6-e56379ad85cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:21.409987 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94edd5dd-79b0-4646-b6d6-e56379ad85cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:21.410414 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94edd5dd-79b0-4646-b6d6-e56379ad85cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:21.441905 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94edd5dd-79b0-4646-b6d6-e56379ad85cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:21.442345 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94edd5dd-79b0-4646-b6d6-e56379ad85cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:21.442785 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-94edd5dd-79b0-4646-b6d6-e56379ad85cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lazy-loading 'fault' on Instance uuid cdb0b91c-9a78-49a1-a96b-016c09759655 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:04:21.490265 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-94edd5dd-79b0-4646-b6d6-e56379ad85cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:21.500978 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-94edd5dd-79b0-4646-b6d6-e56379ad85cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:21.502503 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-94edd5dd-79b0-4646-b6d6-e56379ad85cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:21.503671 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-94edd5dd-79b0-4646-b6d6-e56379ad85cb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 200 len: 1369 microversion: 2.20 time: 0.107505 Jul 31 20:04:21.504451 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 321/648] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:21 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:04:22.087542 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-08737d75-a183-48d1-b16d-f76dc0b09cd5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:22.088264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-08737d75-a183-48d1-b16d-f76dc0b09cd5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:22.094592 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08737d75-a183-48d1-b16d-f76dc0b09cd5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:22.095034 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08737d75-a183-48d1-b16d-f76dc0b09cd5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:22.095797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08737d75-a183-48d1-b16d-f76dc0b09cd5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:22.096224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08737d75-a183-48d1-b16d-f76dc0b09cd5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:22.244369 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-08737d75-a183-48d1-b16d-f76dc0b09cd5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:22.253016 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-08737d75-a183-48d1-b16d-f76dc0b09cd5 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.169952 Jul 31 20:04:22.253622 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 328/649] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:22 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:22.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a4213f43-556a-4e8f-ae99-8a2bcb78e561 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:22.531039 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a4213f43-556a-4e8f-ae99-8a2bcb78e561 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:22.540855 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4213f43-556a-4e8f-ae99-8a2bcb78e561 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:22.541342 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4213f43-556a-4e8f-ae99-8a2bcb78e561 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:22.542105 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4213f43-556a-4e8f-ae99-8a2bcb78e561 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:22.542541 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4213f43-556a-4e8f-ae99-8a2bcb78e561 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:22.556592 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-a4213f43-556a-4e8f-ae99-8a2bcb78e561 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] HTTP exception thrown: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a4213f43-556a-4e8f-ae99-8a2bcb78e561 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Request method failure captured: Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 HTTP/1.1 Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8oAgPkCXFSCXzAwWcomGYGgRCZSqD5PbiKFhgC_8YXoyG3htprDr9Z9Yaub9xmSevREKTKJLFi7HY8G_jurb8fuiDJI53AJfeqZGpKdCviNEzIplzhE1X7OoiIbUzZ2zxBxTC25E0JpZlxAIQxKfLS4RlfGAzdjv5rTbDlbpM6cYc Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: aed33078067c4aa3b0e1d1bf79fd379d Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:04:22.558307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:04:22.559897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aed33078067c4aa3b0e1d1bf79fd379d"}]}] Jul 31 20:04:22.559897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:04:22.559897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: aed33078067c4aa3b0e1d1bf79fd379d Jul 31 20:04:22.559897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:04:22.559897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeShelveTestJSON-1481706984-project Jul 31 20:04:22.559897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:04:22.559897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:04:22.559897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 008286f78ee44232bf411bd695f0c0ed Jul 31 20:04:22.559897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481706984-project Jul 31 20:04:22.559897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:04:22.559897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:04:22.559897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': 'cdb0b91c-9a78-49a1-a96b-016c09759655'} Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:04:22.560766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:04:22.562006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:22.563093 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a4213f43-556a-4e8f-ae99-8a2bcb78e561 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Returning 404 to user: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:04:22.563093 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a4213f43-556a-4e8f-ae99-8a2bcb78e561 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 404 len: 111 microversion: 2.20 time: 0.036299 Jul 31 20:04:22.563093 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 322/650] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:22 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 20:04:22.568696 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ec09e057-33c7-4c1c-985b-3ef8727cbcc5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '.version_select at 0x7ffa24740310>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:22.591132 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ec09e057-33c7-4c1c-985b-3ef8727cbcc5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-341324256" status: 204 len: 0 microversion: 2.20 time: 0.026278 Jul 31 20:04:22.591678 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 329/651] 10.222.0.48 () {60 vars in 1259 bytes} [Sun Jul 31 20:04:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-341324256 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 20:04:23.203705 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cc03a5c0-6cd8-440b-b5bf-85a18136700c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Action: 'create', calling method: .version_select at 0x7ffa247c8280>, body: {"keypair": {"name": "tempest-keypair-1122594328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpQ72JnpOzDAjdSn3Usq6eJf7MI7KMHWoU3dGAhisgwIaJVtsdbwG2UclnEQiZTAjLTjAj0kYSBcKtox6WKCIps/GJSsNahsqt/9gDFq93to3r+T1TofmFweIUViqvBXA=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:23.219697 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-cc03a5c0-6cd8-440b-b5bf-85a18136700c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Getting quotas for project aed33078067c4aa3b0e1d1bf79fd379d. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:04:23.223752 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-cc03a5c0-6cd8-440b-b5bf-85a18136700c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Getting quotas for user 008286f78ee44232bf411bd695f0c0ed and project aed33078067c4aa3b0e1d1bf79fd379d. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:04:23.248787 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cc03a5c0-6cd8-440b-b5bf-85a18136700c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049024 Jul 31 20:04:23.249413 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 323/652] 10.222.0.48 () {62 vars in 1200 bytes} [Sun Jul 31 20:04:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 31 20:04:23.274493 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d3bb1943-900b-4613-8974-1c1d3f1dba29 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:23.275139 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d3bb1943-900b-4613-8974-1c1d3f1dba29 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:23.282043 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3bb1943-900b-4613-8974-1c1d3f1dba29 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:23.282516 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3bb1943-900b-4613-8974-1c1d3f1dba29 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:23.283303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3bb1943-900b-4613-8974-1c1d3f1dba29 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:23.283776 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3bb1943-900b-4613-8974-1c1d3f1dba29 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:23.492129 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d3bb1943-900b-4613-8974-1c1d3f1dba29 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:23.500654 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d3bb1943-900b-4613-8974-1c1d3f1dba29 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.230729 Jul 31 20:04:23.501545 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 330/653] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:23 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:24.523252 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ef6d95d5-43bd-487d-9152-126c8ae8ae83 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:24.523891 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ef6d95d5-43bd-487d-9152-126c8ae8ae83 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:24.531666 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef6d95d5-43bd-487d-9152-126c8ae8ae83 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:24.532113 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef6d95d5-43bd-487d-9152-126c8ae8ae83 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:24.532871 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef6d95d5-43bd-487d-9152-126c8ae8ae83 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:24.533394 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef6d95d5-43bd-487d-9152-126c8ae8ae83 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:24.792197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ef6d95d5-43bd-487d-9152-126c8ae8ae83 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:24.800519 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ef6d95d5-43bd-487d-9152-126c8ae8ae83 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.281953 Jul 31 20:04:24.801207 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 324/654] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:24 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:24.857367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1372732861", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68dcf029-54c5-4da0-972e-7f6fa1d3a796"}], "security_groups": [{"name": "tempest-securitygroup--943919307"}], "key_name": "tempest-keypair-1122594328", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:24.974102 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] validate_networks() for [('68dcf029-54c5-4da0-972e-7f6fa1d3a796', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:04:25.347249 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:04:25.347675 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:04:25.348136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:04:25.348546 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:04:25.354168 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:04:25.364659 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:25.365216 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:25.366062 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:25.366677 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:25.392053 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Getting quotas for project aed33078067c4aa3b0e1d1bf79fd379d. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:04:25.396077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Getting quotas for user 008286f78ee44232bf411bd695f0c0ed and project aed33078067c4aa3b0e1d1bf79fd379d. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:04:25.410236 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:04:25.412541 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:04:25.468043 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-67119291-da0a-425f-ba1c-96bfbf430bed tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.614979 Jul 31 20:04:25.468685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 331/655] 10.222.0.48 () {62 vars in 1188 bytes} [Sun Jul 31 20:04:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 20:04:25.480117 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-96b7a07f-092e-4580-b348-abf1c7b5668f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:25.480733 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-96b7a07f-092e-4580-b348-abf1c7b5668f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:25.534990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-96b7a07f-092e-4580-b348-abf1c7b5668f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:25.542643 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-96b7a07f-092e-4580-b348-abf1c7b5668f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:25.544231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-96b7a07f-092e-4580-b348-abf1c7b5668f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:25.545457 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-96b7a07f-092e-4580-b348-abf1c7b5668f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1282 microversion: 2.20 time: 0.069376 Jul 31 20:04:25.546223 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 325/656] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:25 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:04:25.823281 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8a2faa46-9cd1-4a9f-b63a-e28d570f9fc2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:25.823887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8a2faa46-9cd1-4a9f-b63a-e28d570f9fc2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:25.830354 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a2faa46-9cd1-4a9f-b63a-e28d570f9fc2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:25.830823 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a2faa46-9cd1-4a9f-b63a-e28d570f9fc2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:25.831650 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a2faa46-9cd1-4a9f-b63a-e28d570f9fc2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:25.832192 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a2faa46-9cd1-4a9f-b63a-e28d570f9fc2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:25.979656 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a2faa46-9cd1-4a9f-b63a-e28d570f9fc2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:25.988223 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8a2faa46-9cd1-4a9f-b63a-e28d570f9fc2 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.169894 Jul 31 20:04:25.988995 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 332/657] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:25 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:26.568736 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-02740818-5e5e-4bd5-96bc-33c55425dff4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:26.569542 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-02740818-5e5e-4bd5-96bc-33c55425dff4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:26.575700 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02740818-5e5e-4bd5-96bc-33c55425dff4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:26.576143 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02740818-5e5e-4bd5-96bc-33c55425dff4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:26.576903 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02740818-5e5e-4bd5-96bc-33c55425dff4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:26.577354 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02740818-5e5e-4bd5-96bc-33c55425dff4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:26.720266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-02740818-5e5e-4bd5-96bc-33c55425dff4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:26.729450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-02740818-5e5e-4bd5-96bc-33c55425dff4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:26.731058 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-02740818-5e5e-4bd5-96bc-33c55425dff4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:26.732383 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-02740818-5e5e-4bd5-96bc-33c55425dff4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1334 microversion: 2.20 time: 0.167853 Jul 31 20:04:26.733433 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 326/658] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:26 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1334 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:04:27.010975 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-62ac293c-d92b-4312-86b1-92ffc1d325f4 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:27.011686 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-62ac293c-d92b-4312-86b1-92ffc1d325f4 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:27.018555 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-62ac293c-d92b-4312-86b1-92ffc1d325f4 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:27.018994 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-62ac293c-d92b-4312-86b1-92ffc1d325f4 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:27.019749 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-62ac293c-d92b-4312-86b1-92ffc1d325f4 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:27.020171 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-62ac293c-d92b-4312-86b1-92ffc1d325f4 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:27.218602 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-62ac293c-d92b-4312-86b1-92ffc1d325f4 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:27.227330 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-62ac293c-d92b-4312-86b1-92ffc1d325f4 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.220476 Jul 31 20:04:27.227906 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 333/659] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:27 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:27.756302 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-db03b5ab-95c8-4600-8bf0-7868547c3458 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:27.756884 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-db03b5ab-95c8-4600-8bf0-7868547c3458 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:27.763610 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db03b5ab-95c8-4600-8bf0-7868547c3458 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:27.764078 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db03b5ab-95c8-4600-8bf0-7868547c3458 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:27.764834 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db03b5ab-95c8-4600-8bf0-7868547c3458 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:27.765290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db03b5ab-95c8-4600-8bf0-7868547c3458 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:27.976980 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-db03b5ab-95c8-4600-8bf0-7868547c3458 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:27.985353 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-db03b5ab-95c8-4600-8bf0-7868547c3458 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:27.986841 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-db03b5ab-95c8-4600-8bf0-7868547c3458 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:27.987943 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-db03b5ab-95c8-4600-8bf0-7868547c3458 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1407 microversion: 2.20 time: 0.235839 Jul 31 20:04:27.988500 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 327/660] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:27 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:04:28.226934 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-3b27b1c1-5686-45dc-9569-a01f79eaf3cc req-8e9abb45-39c4-42cc-8ef4-c6270ca11b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86192351-1ad0-4d52-8496-e85d6e5381dd", "tag": "dc71e4bb-0c50-46be-9265-95e6a82b855e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:28.241137 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3b27b1c1-5686-45dc-9569-a01f79eaf3cc req-8e9abb45-39c4-42cc-8ef4-c6270ca11b8b service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:28.243297 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3b27b1c1-5686-45dc-9569-a01f79eaf3cc req-8e9abb45-39c4-42cc-8ef4-c6270ca11b8b service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:28.249396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-964a8db4-45e4-4c3f-9e4c-32ea4174ed1a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:28.250329 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-964a8db4-45e4-4c3f-9e4c-32ea4174ed1a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:28.257731 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-964a8db4-45e4-4c3f-9e4c-32ea4174ed1a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:28.257914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-3b27b1c1-5686-45dc-9569-a01f79eaf3cc req-8e9abb45-39c4-42cc-8ef4-c6270ca11b8b service nova] Creating event network-changed:dc71e4bb-0c50-46be-9265-95e6a82b855e for instance 86192351-1ad0-4d52-8496-e85d6e5381dd on hv-cinder-84984 Jul 31 20:04:28.258612 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-964a8db4-45e4-4c3f-9e4c-32ea4174ed1a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:28.259584 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-964a8db4-45e4-4c3f-9e4c-32ea4174ed1a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:28.260228 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-964a8db4-45e4-4c3f-9e4c-32ea4174ed1a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:28.270281 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-3b27b1c1-5686-45dc-9569-a01f79eaf3cc req-8e9abb45-39c4-42cc-8ef4-c6270ca11b8b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047453 Jul 31 20:04:28.272002 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 334/661] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:04:28.496708 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-964a8db4-45e4-4c3f-9e4c-32ea4174ed1a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:28.505480 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-964a8db4-45e4-4c3f-9e4c-32ea4174ed1a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.260712 Jul 31 20:04:28.506040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 328/662] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:28 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:29.015884 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-32c8a05e-5bc9-43f4-b8a8-2e334ec7af1e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:29.017040 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-32c8a05e-5bc9-43f4-b8a8-2e334ec7af1e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:29.025978 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32c8a05e-5bc9-43f4-b8a8-2e334ec7af1e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:29.026429 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32c8a05e-5bc9-43f4-b8a8-2e334ec7af1e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:29.027194 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32c8a05e-5bc9-43f4-b8a8-2e334ec7af1e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:29.027621 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32c8a05e-5bc9-43f4-b8a8-2e334ec7af1e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:29.222234 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-32c8a05e-5bc9-43f4-b8a8-2e334ec7af1e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:29.230724 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-32c8a05e-5bc9-43f4-b8a8-2e334ec7af1e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:29.232311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-32c8a05e-5bc9-43f4-b8a8-2e334ec7af1e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:29.233522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-32c8a05e-5bc9-43f4-b8a8-2e334ec7af1e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1407 microversion: 2.20 time: 0.224895 Jul 31 20:04:29.234081 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 335/663] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:29 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:04:29.531624 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-877f39b4-c0d9-4687-8644-a37876df5664 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:29.532617 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-877f39b4-c0d9-4687-8644-a37876df5664 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:29.541919 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-877f39b4-c0d9-4687-8644-a37876df5664 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:29.542628 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-877f39b4-c0d9-4687-8644-a37876df5664 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:29.543428 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-877f39b4-c0d9-4687-8644-a37876df5664 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:29.543853 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-877f39b4-c0d9-4687-8644-a37876df5664 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:29.696186 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-877f39b4-c0d9-4687-8644-a37876df5664 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:29.708097 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-877f39b4-c0d9-4687-8644-a37876df5664 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.182935 Jul 31 20:04:29.708844 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 329/664] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:29 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:30.258379 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-afaf3b04-720a-434d-b1ca-05f7020cc1ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:30.259069 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-afaf3b04-720a-434d-b1ca-05f7020cc1ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:30.266158 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afaf3b04-720a-434d-b1ca-05f7020cc1ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:30.266599 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afaf3b04-720a-434d-b1ca-05f7020cc1ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:30.267344 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afaf3b04-720a-434d-b1ca-05f7020cc1ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:30.267765 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afaf3b04-720a-434d-b1ca-05f7020cc1ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:30.474937 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-afaf3b04-720a-434d-b1ca-05f7020cc1ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:30.483590 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-afaf3b04-720a-434d-b1ca-05f7020cc1ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:30.485423 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-afaf3b04-720a-434d-b1ca-05f7020cc1ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:30.486540 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-afaf3b04-720a-434d-b1ca-05f7020cc1ef tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1407 microversion: 2.20 time: 0.233813 Jul 31 20:04:30.487070 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 336/665] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:30 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:04:30.733373 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-97906ef2-5f83-4409-99d6-aec2a7ae975a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:30.734275 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-97906ef2-5f83-4409-99d6-aec2a7ae975a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:30.743663 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-97906ef2-5f83-4409-99d6-aec2a7ae975a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:30.744102 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-97906ef2-5f83-4409-99d6-aec2a7ae975a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:30.745271 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-97906ef2-5f83-4409-99d6-aec2a7ae975a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:30.745688 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-97906ef2-5f83-4409-99d6-aec2a7ae975a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:30.898318 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-97906ef2-5f83-4409-99d6-aec2a7ae975a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:30.910219 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-97906ef2-5f83-4409-99d6-aec2a7ae975a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.182686 Jul 31 20:04:30.911000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 330/666] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:30 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:31.143459 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1835a4ed-6335-4d12-9b31-f9c11186fdf8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:31.146926 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1835a4ed-6335-4d12-9b31-f9c11186fdf8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:31.153865 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1835a4ed-6335-4d12-9b31-f9c11186fdf8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:31.154312 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1835a4ed-6335-4d12-9b31-f9c11186fdf8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:31.155091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1835a4ed-6335-4d12-9b31-f9c11186fdf8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:31.155520 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1835a4ed-6335-4d12-9b31-f9c11186fdf8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:31.184102 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1835a4ed-6335-4d12-9b31-f9c11186fdf8 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046901 Jul 31 20:04:31.184644 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 337/667] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:04:31 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 20:04:31.254990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b8628d03-07ae-46f5-985f-4f8edd5bfb02 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:31.255487 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b8628d03-07ae-46f5-985f-4f8edd5bfb02 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:31.257586 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:31.262855 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8628d03-07ae-46f5-985f-4f8edd5bfb02 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:31.263314 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8628d03-07ae-46f5-985f-4f8edd5bfb02 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:31.264076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8628d03-07ae-46f5-985f-4f8edd5bfb02 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:31.264514 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8628d03-07ae-46f5-985f-4f8edd5bfb02 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:31.291349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b8628d03-07ae-46f5-985f-4f8edd5bfb02 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:04:31.364970 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b8628d03-07ae-46f5-985f-4f8edd5bfb02 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 204 len: 0 microversion: 2.1 time: 0.113532 Jul 31 20:04:31.365513 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 331/668] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:04:31 2022] DELETE /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:04:31.374817 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-04e6b4e0-4b3e-424b-8d7d-27485ba105da tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:31.375508 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-04e6b4e0-4b3e-424b-8d7d-27485ba105da tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:31.383036 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04e6b4e0-4b3e-424b-8d7d-27485ba105da tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:31.383483 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04e6b4e0-4b3e-424b-8d7d-27485ba105da tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:31.384250 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04e6b4e0-4b3e-424b-8d7d-27485ba105da tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:31.384688 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04e6b4e0-4b3e-424b-8d7d-27485ba105da tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:31.510480 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3a56a766-3552-4132-9dbf-b1b05bbf6b87 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:31.511311 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3a56a766-3552-4132-9dbf-b1b05bbf6b87 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:31.518059 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3a56a766-3552-4132-9dbf-b1b05bbf6b87 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:31.518504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3a56a766-3552-4132-9dbf-b1b05bbf6b87 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:31.519274 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3a56a766-3552-4132-9dbf-b1b05bbf6b87 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:31.519711 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3a56a766-3552-4132-9dbf-b1b05bbf6b87 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:31.526463 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-04e6b4e0-4b3e-424b-8d7d-27485ba105da tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:31.534401 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-04e6b4e0-4b3e-424b-8d7d-27485ba105da tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1672 microversion: 2.1 time: 0.163803 Jul 31 20:04:31.535631 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 338/669] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:31 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:31.650665 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3a56a766-3552-4132-9dbf-b1b05bbf6b87 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:31.658909 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3a56a766-3552-4132-9dbf-b1b05bbf6b87 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:31.660374 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3a56a766-3552-4132-9dbf-b1b05bbf6b87 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:31.661493 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3a56a766-3552-4132-9dbf-b1b05bbf6b87 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1407 microversion: 2.20 time: 0.155476 Jul 31 20:04:31.662045 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 332/670] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:31 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:04:31.937949 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-677ee750-39d2-41de-a952-1f7214b9fef8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:31.938813 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-677ee750-39d2-41de-a952-1f7214b9fef8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:31.949000 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-677ee750-39d2-41de-a952-1f7214b9fef8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:31.949788 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-677ee750-39d2-41de-a952-1f7214b9fef8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:31.951028 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-677ee750-39d2-41de-a952-1f7214b9fef8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:31.951735 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-677ee750-39d2-41de-a952-1f7214b9fef8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:32.105207 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-677ee750-39d2-41de-a952-1f7214b9fef8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:32.117374 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-677ee750-39d2-41de-a952-1f7214b9fef8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.185783 Jul 31 20:04:32.117945 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 339/671] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:31 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:32.558120 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-457e4eb3-f6b5-452d-b368-e54cd01a88b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:32.558881 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-457e4eb3-f6b5-452d-b368-e54cd01a88b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:32.568005 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-457e4eb3-f6b5-452d-b368-e54cd01a88b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:32.568598 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-457e4eb3-f6b5-452d-b368-e54cd01a88b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:32.569647 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-457e4eb3-f6b5-452d-b368-e54cd01a88b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:32.570223 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-457e4eb3-f6b5-452d-b368-e54cd01a88b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:32.588482 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:32.684638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b90d2879-0605-484c-8623-f6fd044cb5d5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:32.685919 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b90d2879-0605-484c-8623-f6fd044cb5d5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:32.692695 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b90d2879-0605-484c-8623-f6fd044cb5d5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:32.693140 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b90d2879-0605-484c-8623-f6fd044cb5d5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:32.693961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b90d2879-0605-484c-8623-f6fd044cb5d5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:32.694390 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b90d2879-0605-484c-8623-f6fd044cb5d5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:32.712107 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-457e4eb3-f6b5-452d-b368-e54cd01a88b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:32.719562 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-457e4eb3-f6b5-452d-b368-e54cd01a88b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1672 microversion: 2.1 time: 0.166646 Jul 31 20:04:32.720121 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 333/672] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:32 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:32.829176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b90d2879-0605-484c-8623-f6fd044cb5d5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:32.837955 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b90d2879-0605-484c-8623-f6fd044cb5d5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:32.839435 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b90d2879-0605-484c-8623-f6fd044cb5d5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:32.840524 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b90d2879-0605-484c-8623-f6fd044cb5d5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1407 microversion: 2.20 time: 0.160317 Jul 31 20:04:32.841086 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 340/673] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:32 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:04:33.146552 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b53f4ea3-dea0-4970-8232-73ae56be3bf8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:33.147149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b53f4ea3-dea0-4970-8232-73ae56be3bf8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:33.153477 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b53f4ea3-dea0-4970-8232-73ae56be3bf8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:33.153835 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b53f4ea3-dea0-4970-8232-73ae56be3bf8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:33.154602 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b53f4ea3-dea0-4970-8232-73ae56be3bf8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:33.155023 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b53f4ea3-dea0-4970-8232-73ae56be3bf8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:33.297456 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b53f4ea3-dea0-4970-8232-73ae56be3bf8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:33.309330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b53f4ea3-dea0-4970-8232-73ae56be3bf8 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1755 microversion: 2.1 time: 0.166448 Jul 31 20:04:33.310164 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 334/674] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:33 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:33.741023 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-42edc9d8-6c9e-4020-ab52-9e425a4912a4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:33.741667 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-42edc9d8-6c9e-4020-ab52-9e425a4912a4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:33.748590 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42edc9d8-6c9e-4020-ab52-9e425a4912a4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:33.749031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42edc9d8-6c9e-4020-ab52-9e425a4912a4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:33.749835 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42edc9d8-6c9e-4020-ab52-9e425a4912a4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:33.750276 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42edc9d8-6c9e-4020-ab52-9e425a4912a4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:33.862476 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6a870e51-2844-4c5c-a6a6-4a768c7922eb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:33.863232 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6a870e51-2844-4c5c-a6a6-4a768c7922eb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:33.871698 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6a870e51-2844-4c5c-a6a6-4a768c7922eb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:33.872161 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6a870e51-2844-4c5c-a6a6-4a768c7922eb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:33.872929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6a870e51-2844-4c5c-a6a6-4a768c7922eb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:33.873607 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6a870e51-2844-4c5c-a6a6-4a768c7922eb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:34.021249 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-42edc9d8-6c9e-4020-ab52-9e425a4912a4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:34.029067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-42edc9d8-6c9e-4020-ab52-9e425a4912a4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1672 microversion: 2.1 time: 0.291901 Jul 31 20:04:34.029894 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 341/675] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:33 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1672 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:34.123967 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6a870e51-2844-4c5c-a6a6-4a768c7922eb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:34.133199 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6a870e51-2844-4c5c-a6a6-4a768c7922eb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:34.134726 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6a870e51-2844-4c5c-a6a6-4a768c7922eb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:34.135853 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6a870e51-2844-4c5c-a6a6-4a768c7922eb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1407 microversion: 2.20 time: 0.277500 Jul 31 20:04:34.143779 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 335/676] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:33 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:04:34.334989 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ac3ff105-d333-468f-936e-29a776684661 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:34.335607 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ac3ff105-d333-468f-936e-29a776684661 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:34.342185 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac3ff105-d333-468f-936e-29a776684661 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:34.342638 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac3ff105-d333-468f-936e-29a776684661 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:34.343391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac3ff105-d333-468f-936e-29a776684661 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:34.343820 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac3ff105-d333-468f-936e-29a776684661 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:34.346487 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:34.573280 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ac3ff105-d333-468f-936e-29a776684661 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:34.581763 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ac3ff105-d333-468f-936e-29a776684661 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1758 microversion: 2.1 time: 0.250685 Jul 31 20:04:34.582339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 342/677] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:34 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1758 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:35.051758 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-26e789a4-6ea7-44ff-80ca-8133d4a4ee2c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:35.052343 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-26e789a4-6ea7-44ff-80ca-8133d4a4ee2c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:35.061467 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-26e789a4-6ea7-44ff-80ca-8133d4a4ee2c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:35.062694 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-26e789a4-6ea7-44ff-80ca-8133d4a4ee2c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:35.063737 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-26e789a4-6ea7-44ff-80ca-8133d4a4ee2c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:35.064471 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-26e789a4-6ea7-44ff-80ca-8133d4a4ee2c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:35.072439 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-94e34309-f4d2-4429-ac65-3afc96a622af req-661adb1e-7d79-4b3c-9139-d11d5aaf2ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485", "name": "network-vif-deleted", "tag": "b365ebcd-da3b-4922-a38f-6b3e66392c64"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:35.086911 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-94e34309-f4d2-4429-ac65-3afc96a622af req-661adb1e-7d79-4b3c-9139-d11d5aaf2ef6 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:35.088631 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-94e34309-f4d2-4429-ac65-3afc96a622af req-661adb1e-7d79-4b3c-9139-d11d5aaf2ef6 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:35.106900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-94e34309-f4d2-4429-ac65-3afc96a622af req-661adb1e-7d79-4b3c-9139-d11d5aaf2ef6 service nova] Creating event network-vif-deleted:b365ebcd-da3b-4922-a38f-6b3e66392c64 for instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 on hv-cinder-84984 Jul 31 20:04:35.115677 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-94e34309-f4d2-4429-ac65-3afc96a622af req-661adb1e-7d79-4b3c-9139-d11d5aaf2ef6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046800 Jul 31 20:04:35.116874 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 343/678] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:35.124391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1c08178a-8091-4120-94ae-6b367ff6dc87 req-40167bcb-d48e-45bf-a4e8-8e7c7506eba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86192351-1ad0-4d52-8496-e85d6e5381dd", "name": "network-vif-plugged", "status": "completed", "tag": "dc71e4bb-0c50-46be-9265-95e6a82b855e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:35.136146 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1c08178a-8091-4120-94ae-6b367ff6dc87 req-40167bcb-d48e-45bf-a4e8-8e7c7506eba7 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:35.137040 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1c08178a-8091-4120-94ae-6b367ff6dc87 req-40167bcb-d48e-45bf-a4e8-8e7c7506eba7 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:35.139605 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-26e789a4-6ea7-44ff-80ca-8133d4a4ee2c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:35.147669 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-26e789a4-6ea7-44ff-80ca-8133d4a4ee2c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1606 microversion: 2.1 time: 0.099709 Jul 31 20:04:35.161190 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 336/679] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:35 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1606 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:35.161395 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1c08178a-8091-4120-94ae-6b367ff6dc87 req-40167bcb-d48e-45bf-a4e8-8e7c7506eba7 service nova] Creating event network-vif-plugged:dc71e4bb-0c50-46be-9265-95e6a82b855e for instance 86192351-1ad0-4d52-8496-e85d6e5381dd on hv-cinder-84984 Jul 31 20:04:35.161395 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1c08178a-8091-4120-94ae-6b367ff6dc87 req-40167bcb-d48e-45bf-a4e8-8e7c7506eba7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041451 Jul 31 20:04:35.161395 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 344/680] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:35.169352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c03bd860-7182-4912-9ce3-9256ae4b51d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:35.169920 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c03bd860-7182-4912-9ce3-9256ae4b51d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:35.176000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c03bd860-7182-4912-9ce3-9256ae4b51d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:35.176456 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c03bd860-7182-4912-9ce3-9256ae4b51d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:35.177584 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c03bd860-7182-4912-9ce3-9256ae4b51d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:35.177710 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c03bd860-7182-4912-9ce3-9256ae4b51d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:35.322466 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c03bd860-7182-4912-9ce3-9256ae4b51d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:35.330838 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c03bd860-7182-4912-9ce3-9256ae4b51d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:35.332853 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c03bd860-7182-4912-9ce3-9256ae4b51d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:35.334209 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c03bd860-7182-4912-9ce3-9256ae4b51d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1407 microversion: 2.20 time: 0.171158 Jul 31 20:04:35.334940 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 337/681] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:35 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:04:36.170816 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:36.171566 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:36.176341 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-911fa79e-0493-4742-8706-1ccd59f02245 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:36.177030 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-911fa79e-0493-4742-8706-1ccd59f02245 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:36.188680 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-911fa79e-0493-4742-8706-1ccd59f02245 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:36.189131 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-911fa79e-0493-4742-8706-1ccd59f02245 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:36.190732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-911fa79e-0493-4742-8706-1ccd59f02245 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:36.190732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-911fa79e-0493-4742-8706-1ccd59f02245 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:36.227737 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-911fa79e-0493-4742-8706-1ccd59f02245 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:36.228186 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-911fa79e-0493-4742-8706-1ccd59f02245 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:36.228641 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-911fa79e-0493-4742-8706-1ccd59f02245 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lazy-loading 'fault' on Instance uuid bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:04:36.272378 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-911fa79e-0493-4742-8706-1ccd59f02245 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:36.279303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-911fa79e-0493-4742-8706-1ccd59f02245 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 200 len: 1328 microversion: 2.1 time: 0.109544 Jul 31 20:04:36.279885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 345/682] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:36 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:36.361127 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-93567088-b6dc-42f5-83a7-b61ea4c85d9d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:36.361972 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-93567088-b6dc-42f5-83a7-b61ea4c85d9d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:36.364918 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:36.372906 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93567088-b6dc-42f5-83a7-b61ea4c85d9d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:36.373383 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93567088-b6dc-42f5-83a7-b61ea4c85d9d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:36.374145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93567088-b6dc-42f5-83a7-b61ea4c85d9d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:36.374573 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93567088-b6dc-42f5-83a7-b61ea4c85d9d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:36.516945 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-93567088-b6dc-42f5-83a7-b61ea4c85d9d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:36.525094 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-93567088-b6dc-42f5-83a7-b61ea4c85d9d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:36.526659 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-93567088-b6dc-42f5-83a7-b61ea4c85d9d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:36.527798 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-93567088-b6dc-42f5-83a7-b61ea4c85d9d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1407 microversion: 2.20 time: 0.173453 Jul 31 20:04:36.528350 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 338/683] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:36 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:04:37.304945 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85144654-f21e-4c8e-8036-1e2f93589dd0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:37.306019 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-85144654-f21e-4c8e-8036-1e2f93589dd0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:37.314493 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85144654-f21e-4c8e-8036-1e2f93589dd0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:37.315042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85144654-f21e-4c8e-8036-1e2f93589dd0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:37.315976 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85144654-f21e-4c8e-8036-1e2f93589dd0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:37.316507 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85144654-f21e-4c8e-8036-1e2f93589dd0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:37.333319 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-85144654-f21e-4c8e-8036-1e2f93589dd0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] HTTP exception thrown: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85144654-f21e-4c8e-8036-1e2f93589dd0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Request method failure captured: Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 HTTP/1.1 Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8sCPcuX64qkgxzlAe-KWSYFEGfDu3jDr7L98bWyTBIdLsI__PF_MFZflc9MBZylcwQPziH62cLMjzLzrEqKtk1521R7gJCpIhFMqWcowc4C9syFYZPR1kOP6OsgTz9rRxMlRoGr79JhEgH3vzKaAEYXkc8UJ7XQm8rG877wndhfTo Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: ebb02d5d721347988f4eaff1bb027dcf Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:04:37.335322 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:04:37.337177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ebb02d5d721347988f4eaff1bb027dcf"}]}] Jul 31 20:04:37.337177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:04:37.337177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ebb02d5d721347988f4eaff1bb027dcf Jul 31 20:04:37.337177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:04:37.337177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-1202173152-project Jul 31 20:04:37.337177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:04:37.337177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:04:37.337177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 83717eeddd7347209a660ce46877d41d Jul 31 20:04:37.337177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-1202173152-project Jul 31 20:04:37.337177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:04:37.337177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:04:37.337177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': 'bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485'} Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:04:37.338007 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:04:37.339246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:04:37.340441 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85144654-f21e-4c8e-8036-1e2f93589dd0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Returning 404 to user: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:04:37.340441 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-85144654-f21e-4c8e-8036-1e2f93589dd0 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 404 len: 111 microversion: 2.1 time: 0.038600 Jul 31 20:04:37.340441 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 346/684] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:37 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:04:37.346029 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0b814470-b8f6-4b3d-8111-bcf8e570788a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '.version_select at 0x7ffa247c8700>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:37.367835 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0b814470-b8f6-4b3d-8111-bcf8e570788a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1901587645" status: 202 len: 0 microversion: 2.1 time: 0.025549 Jul 31 20:04:37.368642 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 339/685] 10.222.0.48 () {58 vars in 1221 bytes} [Sun Jul 31 20:04:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1901587645 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:04:37.615768 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2cdcffa5-255c-4084-82f6-86fc1044793f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:37.616674 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2cdcffa5-255c-4084-82f6-86fc1044793f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:37.623257 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2cdcffa5-255c-4084-82f6-86fc1044793f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:37.623783 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2cdcffa5-255c-4084-82f6-86fc1044793f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:37.624625 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2cdcffa5-255c-4084-82f6-86fc1044793f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:37.625243 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2cdcffa5-255c-4084-82f6-86fc1044793f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:37.825676 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2cdcffa5-255c-4084-82f6-86fc1044793f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:37.835830 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2cdcffa5-255c-4084-82f6-86fc1044793f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:37.838121 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2cdcffa5-255c-4084-82f6-86fc1044793f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:37.839301 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2cdcffa5-255c-4084-82f6-86fc1044793f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1599 microversion: 2.20 time: 0.293050 Jul 31 20:04:37.839832 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 347/686] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:04:37 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1599 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:04:37.862462 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-56307846-6930-408e-a416-45ad1f9dd435 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:37.863328 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-56307846-6930-408e-a416-45ad1f9dd435 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:37.870439 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56307846-6930-408e-a416-45ad1f9dd435 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:37.870871 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56307846-6930-408e-a416-45ad1f9dd435 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:37.871864 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56307846-6930-408e-a416-45ad1f9dd435 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:37.872478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56307846-6930-408e-a416-45ad1f9dd435 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:37.976378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-56307846-6930-408e-a416-45ad1f9dd435 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.118149 Jul 31 20:04:37.977356 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 340/687] 10.222.0.48 () {60 vars in 1316 bytes} [Sun Jul 31 20:04:37 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 20:04:38.209389 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-66748e1c-f8a4-436e-b775-d37a1899c888 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Action: 'create', calling method: .version_select at 0x7ffa24821670>, body: {"keypair": {"name": "tempest-keypair-1240862355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNV1sUNTySWKbFy1CleKLO2J6w1o01kiN4NNPW4buck4vpDFjJo/ql5OgUElWxsMets1aG3ZlFxxDwg1gV98kB5VH+mki2HY881I6gs6Ce1p9MjEtv9yqqYRtFPWGGIarw=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:38.226289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-66748e1c-f8a4-436e-b775-d37a1899c888 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Getting quotas for project ebb02d5d721347988f4eaff1bb027dcf. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:04:38.230150 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-66748e1c-f8a4-436e-b775-d37a1899c888 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Getting quotas for user 83717eeddd7347209a660ce46877d41d and project ebb02d5d721347988f4eaff1bb027dcf. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:04:38.254091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-66748e1c-f8a4-436e-b775-d37a1899c888 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048580 Jul 31 20:04:38.254689 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 348/688] 10.222.0.48 () {60 vars in 1159 bytes} [Sun Jul 31 20:04:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:38.831334 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3ce58e17-bd9b-4054-baae-cc0983b17e6e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:38.832519 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3ce58e17-bd9b-4054-baae-cc0983b17e6e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:38.840379 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ce58e17-bd9b-4054-baae-cc0983b17e6e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:38.841046 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ce58e17-bd9b-4054-baae-cc0983b17e6e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:38.842022 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ce58e17-bd9b-4054-baae-cc0983b17e6e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:38.842631 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ce58e17-bd9b-4054-baae-cc0983b17e6e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:38.870082 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3ce58e17-bd9b-4054-baae-cc0983b17e6e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:04:38.960984 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3ce58e17-bd9b-4054-baae-cc0983b17e6e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 204 len: 0 microversion: 2.1 time: 0.132905 Jul 31 20:04:38.961705 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 341/689] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:04:38 2022] DELETE /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:04:38.970871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d314fca3-53c0-450e-aa5b-682024611b6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:38.972234 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d314fca3-53c0-450e-aa5b-682024611b6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:38.978699 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d314fca3-53c0-450e-aa5b-682024611b6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:38.979145 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d314fca3-53c0-450e-aa5b-682024611b6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:38.979910 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d314fca3-53c0-450e-aa5b-682024611b6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:38.980510 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d314fca3-53c0-450e-aa5b-682024611b6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:39.168312 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d314fca3-53c0-450e-aa5b-682024611b6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:39.176417 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d314fca3-53c0-450e-aa5b-682024611b6b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1577 microversion: 2.1 time: 0.210243 Jul 31 20:04:39.177312 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 349/690] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:38 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:39.321635 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-5bef3f8a-096c-49d0-aca1-6155c105da76 req-facf41e2-33ad-49c5-abb4-971f2a418fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86192351-1ad0-4d52-8496-e85d6e5381dd", "tag": "dc71e4bb-0c50-46be-9265-95e6a82b855e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:39.331245 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5bef3f8a-096c-49d0-aca1-6155c105da76 req-facf41e2-33ad-49c5-abb4-971f2a418fe8 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:39.331926 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5bef3f8a-096c-49d0-aca1-6155c105da76 req-facf41e2-33ad-49c5-abb4-971f2a418fe8 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:39.343755 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-5bef3f8a-096c-49d0-aca1-6155c105da76 req-facf41e2-33ad-49c5-abb4-971f2a418fe8 service nova] Creating event network-changed:dc71e4bb-0c50-46be-9265-95e6a82b855e for instance 86192351-1ad0-4d52-8496-e85d6e5381dd on hv-cinder-84984 Jul 31 20:04:39.349252 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-5bef3f8a-096c-49d0-aca1-6155c105da76 req-facf41e2-33ad-49c5-abb4-971f2a418fe8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031652 Jul 31 20:04:39.353813 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 342/691] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:39.625411 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1174953547", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47480458-3271-41da-9c92-4450622fa327"}], "security_groups": [{"name": "tempest-securitygroup--1004136158"}], "key_name": "tempest-keypair-1240862355", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:39.729821 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] validate_networks() for [('47480458-3271-41da-9c92-4450622fa327', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:04:40.106500 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:04:40.107179 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:04:40.107336 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:04:40.107771 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:04:40.108159 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:04:40.117570 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:40.118184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:40.118879 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:40.119356 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:40.137696 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Getting quotas for project ebb02d5d721347988f4eaff1bb027dcf. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:04:40.141771 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Getting quotas for user 83717eeddd7347209a660ce46877d41d and project ebb02d5d721347988f4eaff1bb027dcf. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:04:40.144074 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:40.154643 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:04:40.156940 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:04:40.199702 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-92c1bdbc-1d35-47a5-b495-6bfa1c2637b3 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:40.200390 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-92c1bdbc-1d35-47a5-b495-6bfa1c2637b3 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:40.204147 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-00dd6f48-2bfe-4067-a024-010b708f5fc6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.583087 Jul 31 20:04:40.204973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 350/692] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:04:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:04:40.211130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-92c1bdbc-1d35-47a5-b495-6bfa1c2637b3 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:40.211999 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-92c1bdbc-1d35-47a5-b495-6bfa1c2637b3 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:40.212938 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-92c1bdbc-1d35-47a5-b495-6bfa1c2637b3 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:40.213623 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-92c1bdbc-1d35-47a5-b495-6bfa1c2637b3 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:40.215509 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8a4457ba-55c3-478c-b74f-65198133b5f5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:40.216125 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8a4457ba-55c3-478c-b74f-65198133b5f5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:40.283787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a4457ba-55c3-478c-b74f-65198133b5f5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:40.291919 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8a4457ba-55c3-478c-b74f-65198133b5f5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1238 microversion: 2.1 time: 0.080255 Jul 31 20:04:40.302092 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 351/693] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:40 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:04:40.415745 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-92c1bdbc-1d35-47a5-b495-6bfa1c2637b3 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:40.423444 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-92c1bdbc-1d35-47a5-b495-6bfa1c2637b3 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1577 microversion: 2.1 time: 0.228561 Jul 31 20:04:40.427005 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 343/694] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:40 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:40.998396 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2b65cea0-650d-499d-b222-a0d75b3c98ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:40.998965 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2b65cea0-650d-499d-b222-a0d75b3c98ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:41.005728 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b65cea0-650d-499d-b222-a0d75b3c98ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:41.006243 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b65cea0-650d-499d-b222-a0d75b3c98ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:41.007075 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b65cea0-650d-499d-b222-a0d75b3c98ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:41.007490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b65cea0-650d-499d-b222-a0d75b3c98ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:41.030910 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2b65cea0-650d-499d-b222-a0d75b3c98ff tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/ips" status: 200 len: 149 microversion: 2.1 time: 0.095380 Jul 31 20:04:41.031772 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 352/695] 10.222.0.48 () {58 vars in 1248 bytes} [Sun Jul 31 20:04:40 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/ips => generated 149 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:41.393775 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-015bbf92-b0af-421f-b8ca-005fa35755b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:41.394405 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-015bbf92-b0af-421f-b8ca-005fa35755b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:41.401556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-015bbf92-b0af-421f-b8ca-005fa35755b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:41.402001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-015bbf92-b0af-421f-b8ca-005fa35755b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:41.402805 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-015bbf92-b0af-421f-b8ca-005fa35755b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:41.403258 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-015bbf92-b0af-421f-b8ca-005fa35755b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:41.446227 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-209e1f05-7f5d-4589-b7cd-4864c79a2acf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:41.447275 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-209e1f05-7f5d-4589-b7cd-4864c79a2acf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:41.454308 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-209e1f05-7f5d-4589-b7cd-4864c79a2acf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:41.454848 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-209e1f05-7f5d-4589-b7cd-4864c79a2acf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:41.455686 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-209e1f05-7f5d-4589-b7cd-4864c79a2acf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:41.456202 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-209e1f05-7f5d-4589-b7cd-4864c79a2acf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:41.726756 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-015bbf92-b0af-421f-b8ca-005fa35755b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:41.734792 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-015bbf92-b0af-421f-b8ca-005fa35755b1 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1298 microversion: 2.1 time: 0.423407 Jul 31 20:04:41.735448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 344/696] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:41 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1298 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:41.945565 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-209e1f05-7f5d-4589-b7cd-4864c79a2acf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:41.953880 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-209e1f05-7f5d-4589-b7cd-4864c79a2acf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1577 microversion: 2.1 time: 0.512480 Jul 31 20:04:41.954580 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 353/697] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:41 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1577 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:42.378342 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7093db92-64b9-4af9-9de5-8f064a4211bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a943bf10-b546-4c8a-96a9-cabb17835e1a"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:42.380776 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7093db92-64b9-4af9-9de5-8f064a4211bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:42.387575 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7093db92-64b9-4af9-9de5-8f064a4211bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:42.388017 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7093db92-64b9-4af9-9de5-8f064a4211bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:42.388768 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7093db92-64b9-4af9-9de5-8f064a4211bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:42.389246 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7093db92-64b9-4af9-9de5-8f064a4211bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:42.602311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1bbda936-25a3-4f92-b8fa-2430a6ba6328 req-29a7ff23-4789-4e5a-b60f-88b34f587378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0dc439c-b3b3-443c-8680-f7b1623dbe29", "name": "network-vif-deleted", "tag": "63e21ff2-2376-43b2-97f2-7343a4970d01"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:42.616566 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1bbda936-25a3-4f92-b8fa-2430a6ba6328 req-29a7ff23-4789-4e5a-b60f-88b34f587378 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:42.617041 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1bbda936-25a3-4f92-b8fa-2430a6ba6328 req-29a7ff23-4789-4e5a-b60f-88b34f587378 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:42.636630 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1bbda936-25a3-4f92-b8fa-2430a6ba6328 req-29a7ff23-4789-4e5a-b60f-88b34f587378 service nova] Creating event network-vif-deleted:63e21ff2-2376-43b2-97f2-7343a4970d01 for instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 on hv-cinder-84984 Jul 31 20:04:42.644092 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1bbda936-25a3-4f92-b8fa-2430a6ba6328 req-29a7ff23-4789-4e5a-b60f-88b34f587378 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049866 Jul 31 20:04:42.645413 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 354/698] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:42.757662 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7c7bba4f-0086-4522-a575-e3e2cecf833b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:42.758735 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7c7bba4f-0086-4522-a575-e3e2cecf833b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:42.765822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c7bba4f-0086-4522-a575-e3e2cecf833b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:42.766032 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7093db92-64b9-4af9-9de5-8f064a4211bc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "POST /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391297 Jul 31 20:04:42.771154 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c7bba4f-0086-4522-a575-e3e2cecf833b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:42.771296 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 345/699] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:04:42 2022] POST /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:04:42.771408 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c7bba4f-0086-4522-a575-e3e2cecf833b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:42.771408 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c7bba4f-0086-4522-a575-e3e2cecf833b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:42.981102 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2e1e3658-0520-4be2-b975-4e2b8dcd4abe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:42.982778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2e1e3658-0520-4be2-b975-4e2b8dcd4abe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:43.004202 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7c7bba4f-0086-4522-a575-e3e2cecf833b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:43.005411 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e1e3658-0520-4be2-b975-4e2b8dcd4abe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:43.007038 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e1e3658-0520-4be2-b975-4e2b8dcd4abe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:43.008301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e1e3658-0520-4be2-b975-4e2b8dcd4abe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:43.010668 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e1e3658-0520-4be2-b975-4e2b8dcd4abe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:43.015420 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7c7bba4f-0086-4522-a575-e3e2cecf833b tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1364 microversion: 2.1 time: 0.262763 Jul 31 20:04:43.019221 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 355/700] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:42 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:43.144125 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2e1e3658-0520-4be2-b975-4e2b8dcd4abe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:43.154683 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2e1e3658-0520-4be2-b975-4e2b8dcd4abe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 200 len: 1225 microversion: 2.1 time: 0.181896 Jul 31 20:04:43.155650 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 346/701] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:42 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 1225 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:44.042845 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e1379d3a-a4c9-49db-aa91-9fabb53f350e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:44.043421 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e1379d3a-a4c9-49db-aa91-9fabb53f350e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:44.050400 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1379d3a-a4c9-49db-aa91-9fabb53f350e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:44.050853 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1379d3a-a4c9-49db-aa91-9fabb53f350e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:44.051628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1379d3a-a4c9-49db-aa91-9fabb53f350e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:44.052054 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1379d3a-a4c9-49db-aa91-9fabb53f350e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:44.175385 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-13ca200b-38bd-44fe-89f0-de50231106d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:44.176086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-13ca200b-38bd-44fe-89f0-de50231106d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:44.183005 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-13ca200b-38bd-44fe-89f0-de50231106d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:44.183455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-13ca200b-38bd-44fe-89f0-de50231106d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:44.184221 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-13ca200b-38bd-44fe-89f0-de50231106d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:44.184648 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-13ca200b-38bd-44fe-89f0-de50231106d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:44.201987 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-13ca200b-38bd-44fe-89f0-de50231106d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] HTTP exception thrown: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-13ca200b-38bd-44fe-89f0-de50231106d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Request method failure captured: Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 HTTP/1.1 Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t-Bns-4hAHAbfhfpj7j--iszqblES_2VUdesanw1Z6iz3LUz2zrcgvxVeA23Z-Ka-VZWwRwtHsqnwF9vymxT-tIgvnFbi4SPE2zoserw-43sGnIfK4AoFi-zjvqgMeD2QjKyRNJ2nyoA3NXo2Aavqz-P9usIMCjD_AIczLAZ3NKELg Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 15e426e0b2bd4bc29e7a8e222fcc8f7e Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestVolumeBootPattern-366523324 Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:04:44.203660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:04:44.205417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}] Jul 31 20:04:44.205417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestVolumeBootPattern-366523324 Jul 31 20:04:44.205417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 15e426e0b2bd4bc29e7a8e222fcc8f7e Jul 31 20:04:44.205417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestVolumeBootPattern-366523324 Jul 31 20:04:44.205417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-TestVolumeBootPattern-366523324-project Jul 31 20:04:44.205417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:04:44.205417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:04:44.205417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: c6d7c6c7a3b5413c9c8d5c1e69d9db4c Jul 31 20:04:44.205417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestVolumeBootPattern-366523324-project Jul 31 20:04:44.205417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:04:44.205417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:04:44.205417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': 'c0dc439c-b3b3-443c-8680-f7b1623dbe29'} Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:04:44.206290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:04:44.207577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:44.208703 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-13ca200b-38bd-44fe-89f0-de50231106d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Returning 404 to user: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:04:44.208703 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-13ca200b-38bd-44fe-89f0-de50231106d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 404 len: 111 microversion: 2.1 time: 0.033695 Jul 31 20:04:44.208703 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 347/702] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:44 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:04:44.241895 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e1379d3a-a4c9-49db-aa91-9fabb53f350e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:44.253398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e1379d3a-a4c9-49db-aa91-9fabb53f350e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1364 microversion: 2.1 time: 0.213568 Jul 31 20:04:44.253943 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 356/703] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:44 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:44.316862 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1607707916", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1052386514", "security_groups": [{"name": "tempest-secgroup-smoke-1065349258"}], "block_device_mapping_v2": [{"uuid": "ea90646e-bd0d-4bc7-bd2d-5b99589dad91", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4ede3dd9-1e02-435f-a555-c3b09c614bb8"}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:44.434754 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] validate_networks() for [('4ede3dd9-1e02-435f-a555-c3b09c614bb8', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:04:44.681284 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-e5d19903-a22f-4b8c-9108-59e3b88d4a49 req-4613fb2a-3a1e-4f6b-8db6-decc804791a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c471e2c-987e-4ad0-add6-c22b5ca1ec73", "tag": "7413dd38-41ac-44d9-ac58-22d2506ad9ce"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:44.691005 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e5d19903-a22f-4b8c-9108-59e3b88d4a49 req-4613fb2a-3a1e-4f6b-8db6-decc804791a2 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:44.691518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e5d19903-a22f-4b8c-9108-59e3b88d4a49 req-4613fb2a-3a1e-4f6b-8db6-decc804791a2 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:44.702755 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-e5d19903-a22f-4b8c-9108-59e3b88d4a49 req-4613fb2a-3a1e-4f6b-8db6-decc804791a2 service nova] Creating event network-changed:7413dd38-41ac-44d9-ac58-22d2506ad9ce for instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 on hv-cinder-84984 Jul 31 20:04:44.707633 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-e5d19903-a22f-4b8c-9108-59e3b88d4a49 req-4613fb2a-3a1e-4f6b-8db6-decc804791a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030189 Jul 31 20:04:44.708229 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 357/704] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:44.818925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:04:44.819347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:04:44.819812 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:04:44.820221 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:04:44.820625 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:04:44.829810 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:44.830255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:44.831050 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:44.831482 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:44.848304 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Getting quotas for project 15e426e0b2bd4bc29e7a8e222fcc8f7e. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:04:44.852336 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Getting quotas for user c6d7c6c7a3b5413c9c8d5c1e69d9db4c and project 15e426e0b2bd4bc29e7a8e222fcc8f7e. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:04:44.909956 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:04:44.912059 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea90646e-bd0d-4bc7-bd2d-5b99589dad91',volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:04:45.048782 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-705fceb3-527d-482d-95d2-a46c43a242d4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.735747 Jul 31 20:04:45.049464 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 348/705] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:04:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:04:45.061867 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce1909e5-6a34-44d9-8ca4-0375c84b1048 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:45.062552 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce1909e5-6a34-44d9-8ca4-0375c84b1048 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:45.118332 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ce1909e5-6a34-44d9-8ca4-0375c84b1048 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:45.125602 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ce1909e5-6a34-44d9-8ca4-0375c84b1048 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1095 microversion: 2.1 time: 0.068628 Jul 31 20:04:45.126176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 358/706] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:45 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:45.274570 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-17b3c15d-002a-4fe7-8a2f-5a9bf263bda5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:45.275223 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-17b3c15d-002a-4fe7-8a2f-5a9bf263bda5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:45.283164 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17b3c15d-002a-4fe7-8a2f-5a9bf263bda5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:45.283609 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17b3c15d-002a-4fe7-8a2f-5a9bf263bda5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:45.284419 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17b3c15d-002a-4fe7-8a2f-5a9bf263bda5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:45.284848 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17b3c15d-002a-4fe7-8a2f-5a9bf263bda5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:45.487443 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-17b3c15d-002a-4fe7-8a2f-5a9bf263bda5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:45.496463 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-17b3c15d-002a-4fe7-8a2f-5a9bf263bda5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1364 microversion: 2.1 time: 0.226179 Jul 31 20:04:45.504391 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 349/707] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:45 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:46.146102 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-be04d8b9-871f-48fe-8c97-52c8f8fad65f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:46.146666 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-be04d8b9-871f-48fe-8c97-52c8f8fad65f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:46.154200 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be04d8b9-871f-48fe-8c97-52c8f8fad65f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:46.154650 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be04d8b9-871f-48fe-8c97-52c8f8fad65f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:46.155416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be04d8b9-871f-48fe-8c97-52c8f8fad65f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:46.155847 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be04d8b9-871f-48fe-8c97-52c8f8fad65f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:46.233426 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-be04d8b9-871f-48fe-8c97-52c8f8fad65f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:46.242325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-be04d8b9-871f-48fe-8c97-52c8f8fad65f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1201 microversion: 2.1 time: 0.100252 Jul 31 20:04:46.243064 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 359/708] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:46 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1201 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:46.521582 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c5f15134-c317-4977-9c31-b6244f639f62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:46.522177 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c5f15134-c317-4977-9c31-b6244f639f62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:46.531027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5f15134-c317-4977-9c31-b6244f639f62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:46.531475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5f15134-c317-4977-9c31-b6244f639f62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:46.532228 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5f15134-c317-4977-9c31-b6244f639f62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:46.532661 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5f15134-c317-4977-9c31-b6244f639f62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:46.551448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:47.009671 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c5f15134-c317-4977-9c31-b6244f639f62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:47.021430 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c5f15134-c317-4977-9c31-b6244f639f62 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1364 microversion: 2.1 time: 0.503555 Jul 31 20:04:47.023519 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 350/709] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:46 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1364 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:47.265789 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6f86114b-f1f5-4d60-9f79-4fb6704b7cc4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:47.267013 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6f86114b-f1f5-4d60-9f79-4fb6704b7cc4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:47.273686 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f86114b-f1f5-4d60-9f79-4fb6704b7cc4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:47.274558 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f86114b-f1f5-4d60-9f79-4fb6704b7cc4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:47.276357 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f86114b-f1f5-4d60-9f79-4fb6704b7cc4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:47.277116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f86114b-f1f5-4d60-9f79-4fb6704b7cc4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:47.478604 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6f86114b-f1f5-4d60-9f79-4fb6704b7cc4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:47.486567 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6f86114b-f1f5-4d60-9f79-4fb6704b7cc4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1279 microversion: 2.1 time: 0.225714 Jul 31 20:04:47.487146 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 360/710] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:47 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:47.963805 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-e88e2257-a5be-4f04-a8c4-0168ad627872 req-87968a73-890d-4471-b05f-0f1f85a53ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6903e84-ecc4-4445-9058-df88ae4f3d2f", "tag": "5acf938b-5d35-458d-9e0d-0c6a46fac38e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:47.974594 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e88e2257-a5be-4f04-a8c4-0168ad627872 req-87968a73-890d-4471-b05f-0f1f85a53ee1 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:47.975030 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e88e2257-a5be-4f04-a8c4-0168ad627872 req-87968a73-890d-4471-b05f-0f1f85a53ee1 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:47.988893 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-e88e2257-a5be-4f04-a8c4-0168ad627872 req-87968a73-890d-4471-b05f-0f1f85a53ee1 service nova] Creating event network-changed:5acf938b-5d35-458d-9e0d-0c6a46fac38e for instance c6903e84-ecc4-4445-9058-df88ae4f3d2f on hv-cinder-84984 Jul 31 20:04:47.993811 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-e88e2257-a5be-4f04-a8c4-0168ad627872 req-87968a73-890d-4471-b05f-0f1f85a53ee1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034006 Jul 31 20:04:47.994418 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 351/711] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:48.043555 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-744ab4b6-dfd3-4990-a612-045d51feec79 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:48.044429 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-744ab4b6-dfd3-4990-a612-045d51feec79 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:48.050800 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-744ab4b6-dfd3-4990-a612-045d51feec79 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:48.051357 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-744ab4b6-dfd3-4990-a612-045d51feec79 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:48.052148 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-744ab4b6-dfd3-4990-a612-045d51feec79 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:48.052548 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-744ab4b6-dfd3-4990-a612-045d51feec79 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:48.299419 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-744ab4b6-dfd3-4990-a612-045d51feec79 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:48.307708 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-744ab4b6-dfd3-4990-a612-045d51feec79 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1364 microversion: 2.1 time: 0.267980 Jul 31 20:04:48.308281 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 361/712] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:48 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:48.509093 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-aad1c593-537a-42c2-9c5a-a00734b4032a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:48.509941 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-aad1c593-537a-42c2-9c5a-a00734b4032a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:48.517188 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aad1c593-537a-42c2-9c5a-a00734b4032a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:48.517626 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aad1c593-537a-42c2-9c5a-a00734b4032a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:48.518405 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aad1c593-537a-42c2-9c5a-a00734b4032a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:48.518868 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aad1c593-537a-42c2-9c5a-a00734b4032a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:48.722413 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-aad1c593-537a-42c2-9c5a-a00734b4032a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:48.730349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-aad1c593-537a-42c2-9c5a-a00734b4032a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1279 microversion: 2.1 time: 0.225817 Jul 31 20:04:48.730929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 352/713] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:48 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:49.128424 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-3dd8f450-0327-4a5c-9585-ee8a951e78c5 req-404ea8f5-534a-4485-bb21-7fb9ec0666d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c471e2c-987e-4ad0-add6-c22b5ca1ec73", "name": "network-vif-plugged", "status": "completed", "tag": "7413dd38-41ac-44d9-ac58-22d2506ad9ce"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:49.139141 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3dd8f450-0327-4a5c-9585-ee8a951e78c5 req-404ea8f5-534a-4485-bb21-7fb9ec0666d6 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:49.139581 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3dd8f450-0327-4a5c-9585-ee8a951e78c5 req-404ea8f5-534a-4485-bb21-7fb9ec0666d6 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:49.150719 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-3dd8f450-0327-4a5c-9585-ee8a951e78c5 req-404ea8f5-534a-4485-bb21-7fb9ec0666d6 service nova] Creating event network-vif-plugged:7413dd38-41ac-44d9-ac58-22d2506ad9ce for instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 on hv-cinder-84984 Jul 31 20:04:49.155578 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-3dd8f450-0327-4a5c-9585-ee8a951e78c5 req-404ea8f5-534a-4485-bb21-7fb9ec0666d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030915 Jul 31 20:04:49.156177 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 362/714] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:49.332788 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1ca6d341-91ff-43f8-9ce5-0b1e4b3cf496 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:49.333819 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1ca6d341-91ff-43f8-9ce5-0b1e4b3cf496 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:49.342453 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ca6d341-91ff-43f8-9ce5-0b1e4b3cf496 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:49.342893 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ca6d341-91ff-43f8-9ce5-0b1e4b3cf496 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:49.343646 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ca6d341-91ff-43f8-9ce5-0b1e4b3cf496 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:49.344069 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ca6d341-91ff-43f8-9ce5-0b1e4b3cf496 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:49.530535 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1ca6d341-91ff-43f8-9ce5-0b1e4b3cf496 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:49.538315 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1ca6d341-91ff-43f8-9ce5-0b1e4b3cf496 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1364 microversion: 2.1 time: 0.212132 Jul 31 20:04:49.539123 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 353/715] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:49 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:49.757211 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5b4d062-55fd-4b93-9a9e-c649d53e88eb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:49.758408 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d5b4d062-55fd-4b93-9a9e-c649d53e88eb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:49.765885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5b4d062-55fd-4b93-9a9e-c649d53e88eb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:49.766332 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5b4d062-55fd-4b93-9a9e-c649d53e88eb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:49.767102 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5b4d062-55fd-4b93-9a9e-c649d53e88eb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:49.767535 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5b4d062-55fd-4b93-9a9e-c649d53e88eb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:49.920360 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d5b4d062-55fd-4b93-9a9e-c649d53e88eb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:49.928803 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d5b4d062-55fd-4b93-9a9e-c649d53e88eb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1279 microversion: 2.1 time: 0.179528 Jul 31 20:04:49.929413 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 363/716] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:49 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:50.363309 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c943b40d-235f-423a-b603-07b644bb5807 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a943bf10-b546-4c8a-96a9-cabb17835e1a"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:50.365670 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c943b40d-235f-423a-b603-07b644bb5807 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:50.372715 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c943b40d-235f-423a-b603-07b644bb5807 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:50.373170 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c943b40d-235f-423a-b603-07b644bb5807 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:50.373948 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c943b40d-235f-423a-b603-07b644bb5807 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:50.374379 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c943b40d-235f-423a-b603-07b644bb5807 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:50.451863 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-c943b40d-235f-423a-b603-07b644bb5807 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Invalid volume: volume a943bf10-b546-4c8a-96a9-cabb17835e1a is already attached to instances: e30cd600-cded-49be-97de-e78bdff544b8 Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c943b40d-235f-423a-b603-07b644bb5807 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: POST /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments HTTP/1.1 Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 74 Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:04:50.453699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:04:50.455174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:04:50.455174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:04:50.455174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:04:50.455174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:04:50.455174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:04:50.455174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:04:50.455174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:04:50.455174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:04:50.455174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:04:50.455174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Jul 31 20:04:50.455174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {"volumeAttachment": {"volumeId": "a943bf10-b546-4c8a-96a9-cabb17835e1a"}} Jul 31 20:04:50.455174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Invalid volume: volume a943bf10-b546-4c8a-96a9-cabb17835e1a is already attached to instances: e30cd600-cded-49be-97de-e78bdff544b8 Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'server_id': 'e30cd600-cded-49be-97de-e78bdff544b8', 'body': {'volumeAttachment': {'volumeId': 'a943bf10-b546-4c8a-96a9-cabb17835e1a'}}} Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a943bf10-b546-4c8a-96a9-cabb17835e1a is already attached to instances: e30cd600-cded-49be-97de-e78bdff544b8 Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:50.456096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a943bf10-b546-4c8a-96a9-cabb17835e1a is already attached to instances: e30cd600-cded-49be-97de-e78bdff544b8 Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:04:50.457465 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:04:50.458813 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:04:50.458813 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:04:50.458813 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:04:50.458813 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a943bf10-b546-4c8a-96a9-cabb17835e1a is already attached to instances: e30cd600-cded-49be-97de-e78bdff544b8 Jul 31 20:04:50.458813 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:04:50.458813 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c943b40d-235f-423a-b603-07b644bb5807 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 400 to user: Invalid volume: volume a943bf10-b546-4c8a-96a9-cabb17835e1a is already attached to instances: e30cd600-cded-49be-97de-e78bdff544b8 {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:04:50.458813 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c943b40d-235f-423a-b603-07b644bb5807 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "POST /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095787 Jul 31 20:04:50.458813 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 354/717] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:04:50 2022] POST /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 20:04:50.521965 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-697b3c90-a081-4956-b079-fd22648acd81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:50.522720 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-697b3c90-a081-4956-b079-fd22648acd81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:50.524467 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:50.530064 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-697b3c90-a081-4956-b079-fd22648acd81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:50.530516 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-697b3c90-a081-4956-b079-fd22648acd81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:50.531278 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-697b3c90-a081-4956-b079-fd22648acd81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:50.531709 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-697b3c90-a081-4956-b079-fd22648acd81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:50.560064 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-385b7975-8e0b-4904-a9fb-06d86425b178 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:50.560690 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-385b7975-8e0b-4904-a9fb-06d86425b178 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:50.567712 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-385b7975-8e0b-4904-a9fb-06d86425b178 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:50.568154 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-385b7975-8e0b-4904-a9fb-06d86425b178 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:50.568915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-385b7975-8e0b-4904-a9fb-06d86425b178 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:50.569374 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-385b7975-8e0b-4904-a9fb-06d86425b178 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:50.613971 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-697b3c90-a081-4956-b079-fd22648acd81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lazy-loading 'services' on Instance uuid e30cd600-cded-49be-97de-e78bdff544b8 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:04:50.692601 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-697b3c90-a081-4956-b079-fd22648acd81 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments/a943bf10-b546-4c8a-96a9-cabb17835e1a" status: 202 len: 0 microversion: 2.1 time: 0.174363 Jul 31 20:04:50.693531 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 364/718] 10.222.0.48 () {58 vars in 1416 bytes} [Sun Jul 31 20:04:50 2022] DELETE /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments/a943bf10-b546-4c8a-96a9-cabb17835e1a => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:04:50.701654 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-97934f7b-b960-4698-a26b-211ff14a21a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:50.704015 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-97934f7b-b960-4698-a26b-211ff14a21a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:50.708538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-385b7975-8e0b-4904-a9fb-06d86425b178 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:50.710286 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97934f7b-b960-4698-a26b-211ff14a21a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:50.710724 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97934f7b-b960-4698-a26b-211ff14a21a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:50.711475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97934f7b-b960-4698-a26b-211ff14a21a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:50.711900 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97934f7b-b960-4698-a26b-211ff14a21a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:50.716215 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-385b7975-8e0b-4904-a9fb-06d86425b178 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1364 microversion: 2.1 time: 0.160161 Jul 31 20:04:50.716733 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 355/719] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:50 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:50.735680 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:50.742001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-97934f7b-b960-4698-a26b-211ff14a21a8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044443 Jul 31 20:04:50.742542 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 365/720] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:04:50 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:04:50.951562 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-90746908-d381-4eec-a640-6412bf706184 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:50.952324 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-90746908-d381-4eec-a640-6412bf706184 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:50.959590 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90746908-d381-4eec-a640-6412bf706184 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:50.960100 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90746908-d381-4eec-a640-6412bf706184 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:50.961006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90746908-d381-4eec-a640-6412bf706184 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:50.961564 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90746908-d381-4eec-a640-6412bf706184 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:51.109042 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-90746908-d381-4eec-a640-6412bf706184 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:51.116760 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-90746908-d381-4eec-a640-6412bf706184 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1279 microversion: 2.1 time: 0.170021 Jul 31 20:04:51.117438 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 356/721] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:50 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:51.738223 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-81d4bd67-6898-4489-a2ac-643b01fbaa84 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:51.738818 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-81d4bd67-6898-4489-a2ac-643b01fbaa84 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:51.746437 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81d4bd67-6898-4489-a2ac-643b01fbaa84 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:51.746877 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81d4bd67-6898-4489-a2ac-643b01fbaa84 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:51.747617 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81d4bd67-6898-4489-a2ac-643b01fbaa84 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:51.749413 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81d4bd67-6898-4489-a2ac-643b01fbaa84 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:51.754785 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b57ec507-71e1-45c0-8d78-aa0a256d99c2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:51.758794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b57ec507-71e1-45c0-8d78-aa0a256d99c2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:51.767110 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b57ec507-71e1-45c0-8d78-aa0a256d99c2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:51.767642 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b57ec507-71e1-45c0-8d78-aa0a256d99c2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:51.768508 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b57ec507-71e1-45c0-8d78-aa0a256d99c2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:51.768920 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b57ec507-71e1-45c0-8d78-aa0a256d99c2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:51.804800 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b57ec507-71e1-45c0-8d78-aa0a256d99c2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053897 Jul 31 20:04:51.805718 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 357/722] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:04:51 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:51.891944 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-81d4bd67-6898-4489-a2ac-643b01fbaa84 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:51.899759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-81d4bd67-6898-4489-a2ac-643b01fbaa84 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1364 microversion: 2.1 time: 0.166481 Jul 31 20:04:51.900296 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 366/723] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:51 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:52.140721 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5914d761-45f5-4451-bc3e-160948b4f006 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:52.141640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5914d761-45f5-4451-bc3e-160948b4f006 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:52.150441 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5914d761-45f5-4451-bc3e-160948b4f006 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:52.151069 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5914d761-45f5-4451-bc3e-160948b4f006 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:52.152066 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5914d761-45f5-4451-bc3e-160948b4f006 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:52.152493 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5914d761-45f5-4451-bc3e-160948b4f006 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:52.296439 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5914d761-45f5-4451-bc3e-160948b4f006 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:52.304148 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5914d761-45f5-4451-bc3e-160948b4f006 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1267 microversion: 2.1 time: 0.169012 Jul 31 20:04:52.304748 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 358/724] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:52 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:52.818916 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5296590a-50e8-4a22-a458-afd8f6415013 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:52.821451 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5296590a-50e8-4a22-a458-afd8f6415013 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:52.828996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5296590a-50e8-4a22-a458-afd8f6415013 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:52.829476 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5296590a-50e8-4a22-a458-afd8f6415013 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:52.830241 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5296590a-50e8-4a22-a458-afd8f6415013 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:52.830674 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5296590a-50e8-4a22-a458-afd8f6415013 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:52.860433 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5296590a-50e8-4a22-a458-afd8f6415013 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045781 Jul 31 20:04:52.861054 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 367/725] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:04:52 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:52.921389 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-98d27496-ff4e-4f85-a602-55dec23e8625 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:52.922201 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-98d27496-ff4e-4f85-a602-55dec23e8625 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:52.929254 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98d27496-ff4e-4f85-a602-55dec23e8625 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:52.929639 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98d27496-ff4e-4f85-a602-55dec23e8625 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:52.930400 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98d27496-ff4e-4f85-a602-55dec23e8625 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:52.930832 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98d27496-ff4e-4f85-a602-55dec23e8625 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:53.077529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-98d27496-ff4e-4f85-a602-55dec23e8625 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:53.085026 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-98d27496-ff4e-4f85-a602-55dec23e8625 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1551 microversion: 2.1 time: 0.167692 Jul 31 20:04:53.085622 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 359/726] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:52 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1551 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:53.105420 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dce70c41-5746-4292-bcd3-68736988d939 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:53.105923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dce70c41-5746-4292-bcd3-68736988d939 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:53.111956 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dce70c41-5746-4292-bcd3-68736988d939 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:53.112437 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dce70c41-5746-4292-bcd3-68736988d939 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:53.113184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dce70c41-5746-4292-bcd3-68736988d939 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:53.113654 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dce70c41-5746-4292-bcd3-68736988d939 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:53.144590 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-77515d68-c6ac-46c2-925f-968c72adeaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:53.145219 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-77515d68-c6ac-46c2-925f-968c72adeaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:53.152740 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77515d68-c6ac-46c2-925f-968c72adeaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:53.153404 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77515d68-c6ac-46c2-925f-968c72adeaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:53.154744 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77515d68-c6ac-46c2-925f-968c72adeaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:53.155576 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77515d68-c6ac-46c2-925f-968c72adeaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:53.194839 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dce70c41-5746-4292-bcd3-68736988d939 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093487 Jul 31 20:04:53.195680 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 368/727] 10.222.0.48 () {58 vars in 1275 bytes} [Sun Jul 31 20:04:53 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:53.235396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-77515d68-c6ac-46c2-925f-968c72adeaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lazy-loading 'services' on Instance uuid bac54baf-9c5e-4774-be4a-78b89959104f {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:04:53.315024 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-77515d68-c6ac-46c2-925f-968c72adeaf1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments/7d830e84-2e18-42a1-9127-ee501a5883c3" status: 202 len: 0 microversion: 2.1 time: 0.174109 Jul 31 20:04:53.320904 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 360/728] 10.222.0.48 () {58 vars in 1416 bytes} [Sun Jul 31 20:04:53 2022] DELETE /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments/7d830e84-2e18-42a1-9127-ee501a5883c3 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 20:04:53.326430 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-79a92275-e576-4233-9d45-652059eafde6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:53.327090 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a0205a6c-9a15-4c0a-bf2f-bf8c9ecec21c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:53.327438 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-79a92275-e576-4233-9d45-652059eafde6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:53.329907 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a0205a6c-9a15-4c0a-bf2f-bf8c9ecec21c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:53.335623 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79a92275-e576-4233-9d45-652059eafde6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:53.336098 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79a92275-e576-4233-9d45-652059eafde6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:53.336875 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79a92275-e576-4233-9d45-652059eafde6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:53.337374 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79a92275-e576-4233-9d45-652059eafde6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:53.337632 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0205a6c-9a15-4c0a-bf2f-bf8c9ecec21c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:53.338315 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0205a6c-9a15-4c0a-bf2f-bf8c9ecec21c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:53.339151 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0205a6c-9a15-4c0a-bf2f-bf8c9ecec21c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:53.339591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0205a6c-9a15-4c0a-bf2f-bf8c9ecec21c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:53.393895 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a0205a6c-9a15-4c0a-bf2f-bf8c9ecec21c tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071414 Jul 31 20:04:53.394481 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 361/729] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:04:53 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:53.634021 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-79a92275-e576-4233-9d45-652059eafde6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:53.641992 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-79a92275-e576-4233-9d45-652059eafde6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1267 microversion: 2.1 time: 0.320659 Jul 31 20:04:53.642563 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 369/730] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:53 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:04:53.873389 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c14c7e63-0066-41ab-b3f7-200958e4c153 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:53.875683 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c14c7e63-0066-41ab-b3f7-200958e4c153 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:53.881985 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c14c7e63-0066-41ab-b3f7-200958e4c153 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:53.882429 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c14c7e63-0066-41ab-b3f7-200958e4c153 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:53.883197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c14c7e63-0066-41ab-b3f7-200958e4c153 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:53.883628 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c14c7e63-0066-41ab-b3f7-200958e4c153 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:53.912338 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c14c7e63-0066-41ab-b3f7-200958e4c153 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043926 Jul 31 20:04:53.912919 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 362/731] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:04:53 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 20:04:53.974382 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-869e7766-98aa-4525-96ca-f25d44844bfc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:53.974969 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-869e7766-98aa-4525-96ca-f25d44844bfc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:53.981460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-869e7766-98aa-4525-96ca-f25d44844bfc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:53.982047 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-869e7766-98aa-4525-96ca-f25d44844bfc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:53.982700 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-869e7766-98aa-4525-96ca-f25d44844bfc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:53.983126 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-869e7766-98aa-4525-96ca-f25d44844bfc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:54.009283 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-869e7766-98aa-4525-96ca-f25d44844bfc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:04:54.088641 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-869e7766-98aa-4525-96ca-f25d44844bfc tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 204 len: 0 microversion: 2.1 time: 0.118010 Jul 31 20:04:54.089258 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 370/732] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:04:53 2022] DELETE /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 20:04:54.097400 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ada59d43-cb00-4f86-b9f4-dc1171784d3f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:54.098006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ada59d43-cb00-4f86-b9f4-dc1171784d3f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:54.105851 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ada59d43-cb00-4f86-b9f4-dc1171784d3f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:54.106564 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ada59d43-cb00-4f86-b9f4-dc1171784d3f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:54.107679 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ada59d43-cb00-4f86-b9f4-dc1171784d3f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:54.108673 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ada59d43-cb00-4f86-b9f4-dc1171784d3f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:54.302637 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-b21abbe2-da73-4994-9279-80352f425c31 req-692210fb-e233-4eed-b5bc-1a3bb61fef65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c471e2c-987e-4ad0-add6-c22b5ca1ec73", "tag": "7413dd38-41ac-44d9-ac58-22d2506ad9ce"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:54.314744 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b21abbe2-da73-4994-9279-80352f425c31 req-692210fb-e233-4eed-b5bc-1a3bb61fef65 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:54.317489 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b21abbe2-da73-4994-9279-80352f425c31 req-692210fb-e233-4eed-b5bc-1a3bb61fef65 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:54.318051 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ada59d43-cb00-4f86-b9f4-dc1171784d3f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:54.326753 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ada59d43-cb00-4f86-b9f4-dc1171784d3f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1681 microversion: 2.1 time: 0.233196 Jul 31 20:04:54.337703 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 363/733] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:54 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:54.338178 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-b21abbe2-da73-4994-9279-80352f425c31 req-692210fb-e233-4eed-b5bc-1a3bb61fef65 service nova] Creating event network-changed:7413dd38-41ac-44d9-ac58-22d2506ad9ce for instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 on hv-cinder-84984 Jul 31 20:04:54.338178 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-b21abbe2-da73-4994-9279-80352f425c31 req-692210fb-e233-4eed-b5bc-1a3bb61fef65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036441 Jul 31 20:04:54.338178 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 371/734] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:54.406554 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7c75aeed-a5f8-44f1-ba85-ce3855e83c10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:54.409828 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7c75aeed-a5f8-44f1-ba85-ce3855e83c10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:54.416267 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c75aeed-a5f8-44f1-ba85-ce3855e83c10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:54.416811 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c75aeed-a5f8-44f1-ba85-ce3855e83c10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:54.417753 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c75aeed-a5f8-44f1-ba85-ce3855e83c10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:54.418178 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c75aeed-a5f8-44f1-ba85-ce3855e83c10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:54.448077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7c75aeed-a5f8-44f1-ba85-ce3855e83c10 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045623 Jul 31 20:04:54.448609 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 364/735] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:04:54 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:54.663605 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-07609893-ee48-4afb-ac9f-972ca56fb130 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:54.664552 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-07609893-ee48-4afb-ac9f-972ca56fb130 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:54.671965 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07609893-ee48-4afb-ac9f-972ca56fb130 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:54.672414 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07609893-ee48-4afb-ac9f-972ca56fb130 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:54.673190 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07609893-ee48-4afb-ac9f-972ca56fb130 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:54.673842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07609893-ee48-4afb-ac9f-972ca56fb130 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:54.804897 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-07609893-ee48-4afb-ac9f-972ca56fb130 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:54.812682 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-07609893-ee48-4afb-ac9f-972ca56fb130 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1267 microversion: 2.1 time: 0.153697 Jul 31 20:04:54.813264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 372/736] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:54 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:55.348014 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-450ddf3b-5b40-44ba-922d-fa1b237573f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:55.348632 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-450ddf3b-5b40-44ba-922d-fa1b237573f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:55.350681 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:55.351329 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:55.357998 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-450ddf3b-5b40-44ba-922d-fa1b237573f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:55.358439 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-450ddf3b-5b40-44ba-922d-fa1b237573f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:55.359197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-450ddf3b-5b40-44ba-922d-fa1b237573f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:55.359612 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-450ddf3b-5b40-44ba-922d-fa1b237573f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:55.460529 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-74e192e2-3823-401c-8aa6-17a4994a5323 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:55.463054 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-74e192e2-3823-401c-8aa6-17a4994a5323 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:55.465528 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=14 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:55.472949 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74e192e2-3823-401c-8aa6-17a4994a5323 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:55.473682 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74e192e2-3823-401c-8aa6-17a4994a5323 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:55.475041 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74e192e2-3823-401c-8aa6-17a4994a5323 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:55.475717 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74e192e2-3823-401c-8aa6-17a4994a5323 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:55.510310 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-74e192e2-3823-401c-8aa6-17a4994a5323 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053718 Jul 31 20:04:55.510896 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 373/737] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:04:55 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:55.754405 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-450ddf3b-5b40-44ba-922d-fa1b237573f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:55.762090 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-450ddf3b-5b40-44ba-922d-fa1b237573f8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1681 microversion: 2.1 time: 0.418046 Jul 31 20:04:55.762623 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 365/738] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:55 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1681 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:55.833977 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f1216a50-8793-4e12-8223-c7001f7957fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:55.834672 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f1216a50-8793-4e12-8223-c7001f7957fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:55.841100 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1216a50-8793-4e12-8223-c7001f7957fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:55.841580 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1216a50-8793-4e12-8223-c7001f7957fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:55.842342 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1216a50-8793-4e12-8223-c7001f7957fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:55.842774 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1216a50-8793-4e12-8223-c7001f7957fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:56.039251 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f1216a50-8793-4e12-8223-c7001f7957fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:56.050976 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f1216a50-8793-4e12-8223-c7001f7957fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1267 microversion: 2.1 time: 0.220900 Jul 31 20:04:56.051548 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 374/739] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:55 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:56.523127 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-635a8078-6222-4d01-935a-79aea76c6ed9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:56.525549 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-635a8078-6222-4d01-935a-79aea76c6ed9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:56.528227 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:56.533818 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-635a8078-6222-4d01-935a-79aea76c6ed9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:56.534258 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-635a8078-6222-4d01-935a-79aea76c6ed9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:56.535024 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-635a8078-6222-4d01-935a-79aea76c6ed9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:56.535461 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-635a8078-6222-4d01-935a-79aea76c6ed9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:56.566798 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-635a8078-6222-4d01-935a-79aea76c6ed9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047560 Jul 31 20:04:56.567355 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 366/740] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:04:56 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 20:04:56.636736 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f133a68b-8d87-4d5c-8777-53091bdcb6d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:56.637863 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f133a68b-8d87-4d5c-8777-53091bdcb6d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:56.644591 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f133a68b-8d87-4d5c-8777-53091bdcb6d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:56.645027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f133a68b-8d87-4d5c-8777-53091bdcb6d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:56.645872 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f133a68b-8d87-4d5c-8777-53091bdcb6d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:56.646310 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f133a68b-8d87-4d5c-8777-53091bdcb6d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:56.672234 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f133a68b-8d87-4d5c-8777-53091bdcb6d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:04:56.753894 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f133a68b-8d87-4d5c-8777-53091bdcb6d2 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 204 len: 0 microversion: 2.1 time: 0.120560 Jul 31 20:04:56.754826 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 375/741] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:04:56 2022] DELETE /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:04:56.763562 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-403eb083-6209-44d6-b6bd-bebf83f0b442 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:56.764091 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-403eb083-6209-44d6-b6bd-bebf83f0b442 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:56.772488 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-403eb083-6209-44d6-b6bd-bebf83f0b442 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:56.772930 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-403eb083-6209-44d6-b6bd-bebf83f0b442 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:56.773712 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-403eb083-6209-44d6-b6bd-bebf83f0b442 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:56.774133 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-403eb083-6209-44d6-b6bd-bebf83f0b442 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:56.778439 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:56.789619 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4be26a1c-ccf0-4505-9f7b-ca2c5747ca59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:56.790652 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4be26a1c-ccf0-4505-9f7b-ca2c5747ca59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:56.799318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4be26a1c-ccf0-4505-9f7b-ca2c5747ca59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:56.800602 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4be26a1c-ccf0-4505-9f7b-ca2c5747ca59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:56.801959 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4be26a1c-ccf0-4505-9f7b-ca2c5747ca59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:56.802593 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4be26a1c-ccf0-4505-9f7b-ca2c5747ca59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:57.052608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-403eb083-6209-44d6-b6bd-bebf83f0b442 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:57.060603 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-403eb083-6209-44d6-b6bd-bebf83f0b442 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1692 microversion: 2.1 time: 0.301624 Jul 31 20:04:57.065875 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 367/742] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:56 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1692 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:57.066070 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4be26a1c-ccf0-4505-9f7b-ca2c5747ca59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:57.073892 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4be26a1c-ccf0-4505-9f7b-ca2c5747ca59 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1681 microversion: 2.1 time: 0.290983 Jul 31 20:04:57.074788 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 376/743] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:56 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1681 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:57.088988 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-698196f7-2c0d-4e0a-8dfb-5678ec9083f0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:57.089627 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-698196f7-2c0d-4e0a-8dfb-5678ec9083f0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:57.096529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-698196f7-2c0d-4e0a-8dfb-5678ec9083f0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:57.097104 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-698196f7-2c0d-4e0a-8dfb-5678ec9083f0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:57.097884 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-698196f7-2c0d-4e0a-8dfb-5678ec9083f0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:57.098307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-698196f7-2c0d-4e0a-8dfb-5678ec9083f0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:57.310197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-698196f7-2c0d-4e0a-8dfb-5678ec9083f0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:57.317907 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-698196f7-2c0d-4e0a-8dfb-5678ec9083f0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1267 microversion: 2.1 time: 0.242049 Jul 31 20:04:57.318493 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 368/744] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:57 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:57.465476 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-59889b4d-2ec0-4070-ae88-78ca6095641e req-100cc1c2-7eb3-410d-8ff8-1f23faace04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30cd600-cded-49be-97de-e78bdff544b8", "name": "network-vif-deleted", "tag": "70036d21-e25e-49e4-a7f8-df2a7a0f556d"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:04:57.475803 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-59889b4d-2ec0-4070-ae88-78ca6095641e req-100cc1c2-7eb3-410d-8ff8-1f23faace04a service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:57.476242 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-59889b4d-2ec0-4070-ae88-78ca6095641e req-100cc1c2-7eb3-410d-8ff8-1f23faace04a service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:57.488438 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-59889b4d-2ec0-4070-ae88-78ca6095641e req-100cc1c2-7eb3-410d-8ff8-1f23faace04a service nova] Creating event network-vif-deleted:70036d21-e25e-49e4-a7f8-df2a7a0f556d for instance e30cd600-cded-49be-97de-e78bdff544b8 on hv-cinder-84984 Jul 31 20:04:57.492817 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-59889b4d-2ec0-4070-ae88-78ca6095641e req-100cc1c2-7eb3-410d-8ff8-1f23faace04a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031307 Jul 31 20:04:57.493450 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 377/745] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:04:58.082157 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8f092bbe-e5e6-412c-90e2-87dc70dbd8f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:58.082682 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8f092bbe-e5e6-412c-90e2-87dc70dbd8f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:58.090782 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8f092bbe-e5e6-412c-90e2-87dc70dbd8f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:58.090782 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8f092bbe-e5e6-412c-90e2-87dc70dbd8f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:58.091041 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8f092bbe-e5e6-412c-90e2-87dc70dbd8f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:58.091424 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8f092bbe-e5e6-412c-90e2-87dc70dbd8f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:58.097398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-510ad80b-8d39-4b61-9a6b-278b44ff00b4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:58.098377 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-510ad80b-8d39-4b61-9a6b-278b44ff00b4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:58.104962 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-510ad80b-8d39-4b61-9a6b-278b44ff00b4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:58.105472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-510ad80b-8d39-4b61-9a6b-278b44ff00b4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:58.106239 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-510ad80b-8d39-4b61-9a6b-278b44ff00b4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:58.106675 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-510ad80b-8d39-4b61-9a6b-278b44ff00b4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:58.193363 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-510ad80b-8d39-4b61-9a6b-278b44ff00b4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:58.202297 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-510ad80b-8d39-4b61-9a6b-278b44ff00b4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1613 microversion: 2.1 time: 0.109643 Jul 31 20:04:58.203162 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 378/746] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:58 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1613 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:58.258286 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8f092bbe-e5e6-412c-90e2-87dc70dbd8f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:58.267265 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8f092bbe-e5e6-412c-90e2-87dc70dbd8f1 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1692 microversion: 2.1 time: 0.189046 Jul 31 20:04:58.267850 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 369/747] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:58 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1692 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:58.338989 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4def499c-8496-4e7c-b8ed-ffc7d8cc06dc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:58.339617 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4def499c-8496-4e7c-b8ed-ffc7d8cc06dc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:58.346242 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4def499c-8496-4e7c-b8ed-ffc7d8cc06dc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:58.346679 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4def499c-8496-4e7c-b8ed-ffc7d8cc06dc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:58.347443 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4def499c-8496-4e7c-b8ed-ffc7d8cc06dc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:58.347857 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4def499c-8496-4e7c-b8ed-ffc7d8cc06dc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:58.488311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4def499c-8496-4e7c-b8ed-ffc7d8cc06dc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:58.496552 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4def499c-8496-4e7c-b8ed-ffc7d8cc06dc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1267 microversion: 2.1 time: 0.161425 Jul 31 20:04:58.497093 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 379/748] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:58 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:59.227918 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3c84cb96-67b0-4ad2-ab33-eaed1917bf66 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:59.228907 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3c84cb96-67b0-4ad2-ab33-eaed1917bf66 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:59.237022 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3c84cb96-67b0-4ad2-ab33-eaed1917bf66 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:59.237505 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3c84cb96-67b0-4ad2-ab33-eaed1917bf66 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:59.238265 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3c84cb96-67b0-4ad2-ab33-eaed1917bf66 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:59.238695 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3c84cb96-67b0-4ad2-ab33-eaed1917bf66 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:59.287922 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-538e49f0-a18c-431e-871c-993d68c086a0 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:59.288725 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-538e49f0-a18c-431e-871c-993d68c086a0 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:59.295518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-538e49f0-a18c-431e-871c-993d68c086a0 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:59.296047 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-538e49f0-a18c-431e-871c-993d68c086a0 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:59.296887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-538e49f0-a18c-431e-871c-993d68c086a0 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:59.297437 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-538e49f0-a18c-431e-871c-993d68c086a0 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:59.302507 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3c84cb96-67b0-4ad2-ab33-eaed1917bf66 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:59.310242 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3c84cb96-67b0-4ad2-ab33-eaed1917bf66 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1613 microversion: 2.1 time: 0.088802 Jul 31 20:04:59.310780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 370/749] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:59 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:59.429375 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-538e49f0-a18c-431e-871c-993d68c086a0 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:59.431694 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:04:59.438437 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-538e49f0-a18c-431e-871c-993d68c086a0 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1692 microversion: 2.1 time: 0.154359 Jul 31 20:04:59.439051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 380/750] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:59 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:04:59.523023 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-471bddec-585a-4c9a-99bd-ba2e29900e75 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:04:59.524022 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-471bddec-585a-4c9a-99bd-ba2e29900e75 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:04:59.532512 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-471bddec-585a-4c9a-99bd-ba2e29900e75 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:59.533038 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-471bddec-585a-4c9a-99bd-ba2e29900e75 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:59.533884 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-471bddec-585a-4c9a-99bd-ba2e29900e75 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:04:59.534318 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-471bddec-585a-4c9a-99bd-ba2e29900e75 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:04:59.682668 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-471bddec-585a-4c9a-99bd-ba2e29900e75 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:04:59.690582 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-471bddec-585a-4c9a-99bd-ba2e29900e75 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1267 microversion: 2.1 time: 0.174655 Jul 31 20:04:59.691147 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 371/751] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:04:59 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:00.332017 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-033ecce6-b46d-4261-b905-77b22e57a830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:00.332566 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-033ecce6-b46d-4261-b905-77b22e57a830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:00.340490 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-033ecce6-b46d-4261-b905-77b22e57a830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:00.340931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-033ecce6-b46d-4261-b905-77b22e57a830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:00.341811 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-033ecce6-b46d-4261-b905-77b22e57a830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:00.342231 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-033ecce6-b46d-4261-b905-77b22e57a830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:00.409713 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-033ecce6-b46d-4261-b905-77b22e57a830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:00.417466 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-033ecce6-b46d-4261-b905-77b22e57a830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1326 microversion: 2.1 time: 0.089426 Jul 31 20:05:00.418013 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 381/752] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:00 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1326 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:00.459594 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b6f1fb38-30fc-4ee5-bd1a-599d5f7b037f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:00.460181 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b6f1fb38-30fc-4ee5-bd1a-599d5f7b037f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:00.467337 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6f1fb38-30fc-4ee5-bd1a-599d5f7b037f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:00.467782 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6f1fb38-30fc-4ee5-bd1a-599d5f7b037f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:00.468537 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6f1fb38-30fc-4ee5-bd1a-599d5f7b037f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:00.468968 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6f1fb38-30fc-4ee5-bd1a-599d5f7b037f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:00.604654 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b6f1fb38-30fc-4ee5-bd1a-599d5f7b037f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:00.612997 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b6f1fb38-30fc-4ee5-bd1a-599d5f7b037f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1692 microversion: 2.1 time: 0.157316 Jul 31 20:05:00.613596 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 372/753] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:00 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:00.720116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-49c36437-f6d7-4e69-b870-2cd02314cebb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:00.721099 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-49c36437-f6d7-4e69-b870-2cd02314cebb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:00.731865 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49c36437-f6d7-4e69-b870-2cd02314cebb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:00.732406 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49c36437-f6d7-4e69-b870-2cd02314cebb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:00.733259 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49c36437-f6d7-4e69-b870-2cd02314cebb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:00.733594 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49c36437-f6d7-4e69-b870-2cd02314cebb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:00.863803 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-49c36437-f6d7-4e69-b870-2cd02314cebb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:00.873037 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-49c36437-f6d7-4e69-b870-2cd02314cebb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1267 microversion: 2.1 time: 0.159209 Jul 31 20:05:00.873644 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 382/754] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:00 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:01.443060 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0d7d8ecd-313f-46a2-98e9-75fd2f5b7142 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:01.444066 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0d7d8ecd-313f-46a2-98e9-75fd2f5b7142 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:01.453182 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d7d8ecd-313f-46a2-98e9-75fd2f5b7142 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:01.453671 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d7d8ecd-313f-46a2-98e9-75fd2f5b7142 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:01.454480 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d7d8ecd-313f-46a2-98e9-75fd2f5b7142 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:01.454916 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d7d8ecd-313f-46a2-98e9-75fd2f5b7142 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:01.485976 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d7d8ecd-313f-46a2-98e9-75fd2f5b7142 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:01.486615 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d7d8ecd-313f-46a2-98e9-75fd2f5b7142 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:01.486957 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-0d7d8ecd-313f-46a2-98e9-75fd2f5b7142 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lazy-loading 'fault' on Instance uuid e30cd600-cded-49be-97de-e78bdff544b8 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:05:01.530267 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0d7d8ecd-313f-46a2-98e9-75fd2f5b7142 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:01.539362 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0d7d8ecd-313f-46a2-98e9-75fd2f5b7142 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 200 len: 1331 microversion: 2.1 time: 0.103083 Jul 31 20:05:01.540243 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 373/755] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:01 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:01.634365 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-59770d6c-925b-4ff8-a922-660a41d4dd1f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:01.635262 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-59770d6c-925b-4ff8-a922-660a41d4dd1f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:01.642580 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59770d6c-925b-4ff8-a922-660a41d4dd1f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:01.643434 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59770d6c-925b-4ff8-a922-660a41d4dd1f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:01.644422 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59770d6c-925b-4ff8-a922-660a41d4dd1f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:01.645088 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59770d6c-925b-4ff8-a922-660a41d4dd1f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:01.894317 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6d6a0e99-9b33-4f4b-a30b-18a0e88c867d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:01.894920 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6d6a0e99-9b33-4f4b-a30b-18a0e88c867d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:01.895072 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59770d6c-925b-4ff8-a922-660a41d4dd1f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:01.901969 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6d6a0e99-9b33-4f4b-a30b-18a0e88c867d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:01.902427 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6d6a0e99-9b33-4f4b-a30b-18a0e88c867d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:01.902679 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-59770d6c-925b-4ff8-a922-660a41d4dd1f tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1692 microversion: 2.1 time: 0.272089 Jul 31 20:05:01.903160 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6d6a0e99-9b33-4f4b-a30b-18a0e88c867d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:01.903287 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 383/756] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:01 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1692 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:01.903940 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6d6a0e99-9b33-4f4b-a30b-18a0e88c867d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:02.115800 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6d6a0e99-9b33-4f4b-a30b-18a0e88c867d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:02.124102 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6d6a0e99-9b33-4f4b-a30b-18a0e88c867d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1267 microversion: 2.1 time: 0.233946 Jul 31 20:05:02.124632 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 374/757] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:01 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:02.481444 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-11b93396-eb41-46e4-a993-15583163190d req-8fe0b26f-49ad-40f6-aad7-cef5c5c797d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac54baf-9c5e-4774-be4a-78b89959104f", "name": "network-vif-deleted", "tag": "4b015db4-1121-4b9d-8f46-45643ea431bf"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:02.493083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-11b93396-eb41-46e4-a993-15583163190d req-8fe0b26f-49ad-40f6-aad7-cef5c5c797d8 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:02.493457 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-11b93396-eb41-46e4-a993-15583163190d req-8fe0b26f-49ad-40f6-aad7-cef5c5c797d8 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:02.506140 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-11b93396-eb41-46e4-a993-15583163190d req-8fe0b26f-49ad-40f6-aad7-cef5c5c797d8 service nova] Creating event network-vif-deleted:4b015db4-1121-4b9d-8f46-45643ea431bf for instance bac54baf-9c5e-4774-be4a-78b89959104f on hv-cinder-84984 Jul 31 20:05:02.511324 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-11b93396-eb41-46e4-a993-15583163190d req-8fe0b26f-49ad-40f6-aad7-cef5c5c797d8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033421 Jul 31 20:05:02.512410 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 384/758] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:02.560824 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-10d9bde0-d6bf-4573-b7cf-629723ff8b22 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:02.562160 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-10d9bde0-d6bf-4573-b7cf-629723ff8b22 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:02.569302 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10d9bde0-d6bf-4573-b7cf-629723ff8b22 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:02.569873 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10d9bde0-d6bf-4573-b7cf-629723ff8b22 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:02.570736 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10d9bde0-d6bf-4573-b7cf-629723ff8b22 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:02.571232 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10d9bde0-d6bf-4573-b7cf-629723ff8b22 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:02.760724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-10d9bde0-d6bf-4573-b7cf-629723ff8b22 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-10d9bde0-d6bf-4573-b7cf-629723ff8b22 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 HTTP/1.1 Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:05:02.762416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:05:02.764055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:05:02.764055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:05:02.764055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:05:02.764055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:05:02.764055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:05:02.764055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:05:02.764055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:05:02.764055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:05:02.764055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:05:02.764055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:05:02.764055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:05:02.764055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': 'e30cd600-cded-49be-97de-e78bdff544b8'} Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:05:02.764925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:05:02.766440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:02.767752 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-10d9bde0-d6bf-4573-b7cf-629723ff8b22 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 404 to user: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:05:02.767752 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-10d9bde0-d6bf-4573-b7cf-629723ff8b22 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 404 len: 111 microversion: 2.1 time: 0.207551 Jul 31 20:05:02.767752 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 375/759] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:02 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:05:02.773529 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d9144731-9841-4b38-ade0-4424fb3be452 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '.version_select at 0x7ffa2466a5e0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:02.792945 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d9144731-9841-4b38-ade0-4424fb3be452 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-571855253" status: 202 len: 0 microversion: 2.1 time: 0.023652 Jul 31 20:05:02.793897 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 385/760] 10.222.0.48 () {58 vars in 1218 bytes} [Sun Jul 31 20:05:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-571855253 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:05:02.925737 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3fb50b5a-acb2-48d1-a45b-8d19f9c5b553 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:02.926519 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3fb50b5a-acb2-48d1-a45b-8d19f9c5b553 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:02.933358 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fb50b5a-acb2-48d1-a45b-8d19f9c5b553 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:02.937841 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fb50b5a-acb2-48d1-a45b-8d19f9c5b553 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:02.937841 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fb50b5a-acb2-48d1-a45b-8d19f9c5b553 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:02.937841 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fb50b5a-acb2-48d1-a45b-8d19f9c5b553 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:02.973552 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fb50b5a-acb2-48d1-a45b-8d19f9c5b553 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:02.974200 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fb50b5a-acb2-48d1-a45b-8d19f9c5b553 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:02.974807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-3fb50b5a-acb2-48d1-a45b-8d19f9c5b553 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lazy-loading 'fault' on Instance uuid bac54baf-9c5e-4774-be4a-78b89959104f {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:05:03.099471 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3fb50b5a-acb2-48d1-a45b-8d19f9c5b553 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:03.111347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3fb50b5a-acb2-48d1-a45b-8d19f9c5b553 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 200 len: 1336 microversion: 2.1 time: 0.189951 Jul 31 20:05:03.114317 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 376/761] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:02 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 1336 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:03.144944 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1d2c6830-34b1-470c-a2e8-8a5008c518ce tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:03.146021 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1d2c6830-34b1-470c-a2e8-8a5008c518ce tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:03.158210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d2c6830-34b1-470c-a2e8-8a5008c518ce tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:03.158957 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d2c6830-34b1-470c-a2e8-8a5008c518ce tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:03.159963 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d2c6830-34b1-470c-a2e8-8a5008c518ce tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:03.160536 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d2c6830-34b1-470c-a2e8-8a5008c518ce tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:03.389437 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1d2c6830-34b1-470c-a2e8-8a5008c518ce tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:03.397938 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1d2c6830-34b1-470c-a2e8-8a5008c518ce tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1267 microversion: 2.1 time: 0.257153 Jul 31 20:05:03.398939 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 386/762] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:03 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:03.562172 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5408649f-e435-4000-8b72-c0808be315d7 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Action: 'create', calling method: .version_select at 0x7ffa24558430>, body: {"keypair": {"name": "tempest-keypair-1918598570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQLLZVYHk/WW8kFvMi15Rsr3lA8NMmAnfmGL+2f56JcIXH4H7O61PsfZQsQO7Hejn57N8b8i2p7MK+xK68Jfmf+tameuY44h0Xd2+Y+ijWJZWla10LKESc3IeMPljLctw=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:03.578386 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-5408649f-e435-4000-8b72-c0808be315d7 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for project 2f435e60769a43deb3c15b351f97d62c. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:05:03.582360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-5408649f-e435-4000-8b72-c0808be315d7 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for user 76b9c24c8dc94af8b2c8e44be8494e9b and project 2f435e60769a43deb3c15b351f97d62c. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:05:03.605566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5408649f-e435-4000-8b72-c0808be315d7 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047735 Jul 31 20:05:03.606259 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 377/763] 10.222.0.48 () {60 vars in 1159 bytes} [Sun Jul 31 20:05:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:04.136135 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-55c74cc9-7963-4717-960c-be03657c8b0d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:04.137341 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-55c74cc9-7963-4717-960c-be03657c8b0d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: bac54baf-9c5e-4774-be4a-78b89959104f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:04.144500 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55c74cc9-7963-4717-960c-be03657c8b0d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:04.145112 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55c74cc9-7963-4717-960c-be03657c8b0d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:04.146064 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55c74cc9-7963-4717-960c-be03657c8b0d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:04.147160 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55c74cc9-7963-4717-960c-be03657c8b0d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:04.164766 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-55c74cc9-7963-4717-960c-be03657c8b0d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] HTTP exception thrown: Instance bac54baf-9c5e-4774-be4a-78b89959104f could not be found. Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-55c74cc9-7963-4717-960c-be03657c8b0d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Request method failure captured: Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f HTTP/1.1 Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8wkAlbXsas087082cheCywlugC2lHFFc9iVqgo6_sBsR-YY5pZu5t-1nBKYhilL82c6N8gE1zCXnBGzizSkvsRiCQKIGfA7AeTxya_nSNWYEfiyYJL4ENUjFdbfKAqnXJ6B5iGF_OvnduRT1jdq2eFQLBjV9thklPR9a7cgSgtG9I Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 41f4d4561f4f40f8b370b8cc943c97af Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:05:04.166449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:05:04.168027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/41f4d4561f4f40f8b370b8cc943c97af"}]}] Jul 31 20:05:04.168027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:05:04.168027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 41f4d4561f4f40f8b370b8cc943c97af Jul 31 20:05:04.168027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:05:04.168027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-154903434-project Jul 31 20:05:04.168027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:05:04.168027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:05:04.168027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 89abc5820b584315a8413f6402f7ff1f Jul 31 20:05:04.168027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-154903434-project Jul 31 20:05:04.168027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:05:04.168027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance bac54baf-9c5e-4774-be4a-78b89959104f could not be found. Jul 31 20:05:04.168027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': 'bac54baf-9c5e-4774-be4a-78b89959104f'} Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac54baf-9c5e-4774-be4a-78b89959104f could not be found. Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:05:04.168882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac54baf-9c5e-4774-be4a-78b89959104f could not be found. Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac54baf-9c5e-4774-be4a-78b89959104f could not be found. Jul 31 20:05:04.170685 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:04.173031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-55c74cc9-7963-4717-960c-be03657c8b0d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Returning 404 to user: Instance bac54baf-9c5e-4774-be4a-78b89959104f could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:05:04.173031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-55c74cc9-7963-4717-960c-be03657c8b0d tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f" status: 404 len: 111 microversion: 2.1 time: 0.035749 Jul 31 20:05:04.173031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 387/764] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:04 2022] GET /compute/v2.1/servers/bac54baf-9c5e-4774-be4a-78b89959104f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:05:04.178799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2e1c2e6d-9939-417b-b40d-632635319e2b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '.version_select at 0x7ffa245bd3a0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:04.198978 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2e1c2e6d-9939-417b-b40d-632635319e2b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139810082" status: 202 len: 0 microversion: 2.1 time: 0.023938 Jul 31 20:05:04.199740 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 378/765] 10.222.0.48 () {58 vars in 1221 bytes} [Sun Jul 31 20:05:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139810082 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:05:04.418989 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6bdcd123-0aa1-4e2b-a47b-ce1e90c0bdd1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:04.419666 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6bdcd123-0aa1-4e2b-a47b-ce1e90c0bdd1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:04.425535 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:04.427870 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdcd123-0aa1-4e2b-a47b-ce1e90c0bdd1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:04.428465 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdcd123-0aa1-4e2b-a47b-ce1e90c0bdd1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:04.429560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdcd123-0aa1-4e2b-a47b-ce1e90c0bdd1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:04.430142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdcd123-0aa1-4e2b-a47b-ce1e90c0bdd1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:04.909500 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6bdcd123-0aa1-4e2b-a47b-ce1e90c0bdd1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:04.920028 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6bdcd123-0aa1-4e2b-a47b-ce1e90c0bdd1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1267 microversion: 2.1 time: 0.504244 Jul 31 20:05:04.921526 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 388/766] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:04 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1267 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:05.133290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-139898158", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "758cb11a-528c-4227-88a9-030f838941a5"}], "security_groups": [{"name": "tempest-securitygroup--1870303555"}], "key_name": "tempest-keypair-1918598570", "user_data": "}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:05.207571 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-36fbeec6-0e36-4205-8c66-829653999b56 req-922a8cb8-fd65-489c-af4b-7c2ee6c24044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6903e84-ecc4-4445-9058-df88ae4f3d2f", "name": "network-vif-plugged", "status": "completed", "tag": "5acf938b-5d35-458d-9e0d-0c6a46fac38e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:05.220995 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-36fbeec6-0e36-4205-8c66-829653999b56 req-922a8cb8-fd65-489c-af4b-7c2ee6c24044 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:05.221670 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-36fbeec6-0e36-4205-8c66-829653999b56 req-922a8cb8-fd65-489c-af4b-7c2ee6c24044 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:05.236088 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-36fbeec6-0e36-4205-8c66-829653999b56 req-922a8cb8-fd65-489c-af4b-7c2ee6c24044 service nova] Creating event network-vif-plugged:5acf938b-5d35-458d-9e0d-0c6a46fac38e for instance c6903e84-ecc4-4445-9058-df88ae4f3d2f on hv-cinder-84984 Jul 31 20:05:05.242544 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-36fbeec6-0e36-4205-8c66-829653999b56 req-922a8cb8-fd65-489c-af4b-7c2ee6c24044 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038833 Jul 31 20:05:05.243155 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 389/767] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:05:05.244488 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] validate_networks() for [('758cb11a-528c-4227-88a9-030f838941a5', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:05:05.727693 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:05:05.728111 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:05:05.728575 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:05:05.729018 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:05:05.729449 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:05:05.739479 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:05.739935 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:05.740807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:05.741279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:05.759512 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for project 2f435e60769a43deb3c15b351f97d62c. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:05:05.764034 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Getting quotas for user 76b9c24c8dc94af8b2c8e44be8494e9b and project 2f435e60769a43deb3c15b351f97d62c. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:05:05.776244 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:05:05.778568 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:05:05.829170 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-62cde5e0-8b0d-4acf-ae3e-ae059154f06a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.700853 Jul 31 20:05:05.829833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 379/768] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:05:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:05:05.841326 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-74dc7972-d856-4cdb-af5a-4503df07a182 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:05.842069 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-74dc7972-d856-4cdb-af5a-4503df07a182 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:05.898704 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-74dc7972-d856-4cdb-af5a-4503df07a182 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:05.905371 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-74dc7972-d856-4cdb-af5a-4503df07a182 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1241 microversion: 2.1 time: 0.068341 Jul 31 20:05:05.906191 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 390/769] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:05 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:05.941638 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-66546e4c-a29d-4415-b5d4-25d56f52c413 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:05.942282 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-66546e4c-a29d-4415-b5d4-25d56f52c413 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:05.948759 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66546e4c-a29d-4415-b5d4-25d56f52c413 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:05.949192 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66546e4c-a29d-4415-b5d4-25d56f52c413 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:05.949997 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66546e4c-a29d-4415-b5d4-25d56f52c413 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:05.950456 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66546e4c-a29d-4415-b5d4-25d56f52c413 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:06.096137 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-66546e4c-a29d-4415-b5d4-25d56f52c413 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:06.104600 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-66546e4c-a29d-4415-b5d4-25d56f52c413 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1267 microversion: 2.1 time: 0.166896 Jul 31 20:05:06.105174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 380/770] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:05 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:06.930663 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-22b91b19-e27f-4a27-9628-0c46104ff9af tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:06.931662 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-22b91b19-e27f-4a27-9628-0c46104ff9af tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:06.943265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22b91b19-e27f-4a27-9628-0c46104ff9af tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:06.943994 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22b91b19-e27f-4a27-9628-0c46104ff9af tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:06.945223 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22b91b19-e27f-4a27-9628-0c46104ff9af tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:06.945979 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22b91b19-e27f-4a27-9628-0c46104ff9af tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:07.013460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-22b91b19-e27f-4a27-9628-0c46104ff9af tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:07.021050 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-22b91b19-e27f-4a27-9628-0c46104ff9af tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1293 microversion: 2.1 time: 0.096937 Jul 31 20:05:07.021651 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 391/771] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:06 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:07.126417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5873a22a-33c2-4cdf-a1c3-dea9098b9e38 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:07.127041 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5873a22a-33c2-4cdf-a1c3-dea9098b9e38 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:07.129618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-52922a55-fc92-4a38-9a64-2d8d5cf6d1c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:07.130182 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-52922a55-fc92-4a38-9a64-2d8d5cf6d1c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:07.134344 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5873a22a-33c2-4cdf-a1c3-dea9098b9e38 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:07.134793 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5873a22a-33c2-4cdf-a1c3-dea9098b9e38 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:07.135567 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5873a22a-33c2-4cdf-a1c3-dea9098b9e38 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:07.136000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5873a22a-33c2-4cdf-a1c3-dea9098b9e38 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:07.136901 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52922a55-fc92-4a38-9a64-2d8d5cf6d1c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:07.137472 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52922a55-fc92-4a38-9a64-2d8d5cf6d1c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:07.138339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52922a55-fc92-4a38-9a64-2d8d5cf6d1c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:07.138813 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52922a55-fc92-4a38-9a64-2d8d5cf6d1c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:07.163558 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-52922a55-fc92-4a38-9a64-2d8d5cf6d1c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:05:07.244010 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-52922a55-fc92-4a38-9a64-2d8d5cf6d1c6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 204 len: 0 microversion: 2.1 time: 0.118273 Jul 31 20:05:07.244605 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 392/772] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:05:07 2022] DELETE /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:05:07.253279 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-13759f65-c227-4797-bbb7-66c41ea182f9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:07.254001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-13759f65-c227-4797-bbb7-66c41ea182f9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:07.259741 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13759f65-c227-4797-bbb7-66c41ea182f9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:07.260193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13759f65-c227-4797-bbb7-66c41ea182f9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:07.260953 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13759f65-c227-4797-bbb7-66c41ea182f9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:07.261407 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13759f65-c227-4797-bbb7-66c41ea182f9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:07.273970 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5873a22a-33c2-4cdf-a1c3-dea9098b9e38 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:07.282081 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5873a22a-33c2-4cdf-a1c3-dea9098b9e38 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1453 microversion: 2.1 time: 0.159727 Jul 31 20:05:07.282644 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 381/773] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:07 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:07.303631 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d2aead5c-d7d8-486e-9815-806efaa20cc7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:07.304422 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d2aead5c-d7d8-486e-9815-806efaa20cc7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:07.310815 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d2aead5c-d7d8-486e-9815-806efaa20cc7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:07.311333 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d2aead5c-d7d8-486e-9815-806efaa20cc7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:07.312156 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d2aead5c-d7d8-486e-9815-806efaa20cc7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:07.312646 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d2aead5c-d7d8-486e-9815-806efaa20cc7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:07.465830 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-13759f65-c227-4797-bbb7-66c41ea182f9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:07.474057 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-13759f65-c227-4797-bbb7-66c41ea182f9 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1507 microversion: 2.1 time: 0.224813 Jul 31 20:05:07.475316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 393/774] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:07 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:05:07.500004 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d2aead5c-d7d8-486e-9815-806efaa20cc7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:07.507878 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d2aead5c-d7d8-486e-9815-806efaa20cc7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1453 microversion: 2.1 time: 0.208214 Jul 31 20:05:07.508452 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 382/775] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:07 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1453 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:05:08.042053 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e25d59f3-1e31-4c74-94e5-44d7a37b7c3b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:08.042707 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e25d59f3-1e31-4c74-94e5-44d7a37b7c3b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:08.049758 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e25d59f3-1e31-4c74-94e5-44d7a37b7c3b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:08.050218 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e25d59f3-1e31-4c74-94e5-44d7a37b7c3b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:08.050989 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e25d59f3-1e31-4c74-94e5-44d7a37b7c3b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:08.051417 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e25d59f3-1e31-4c74-94e5-44d7a37b7c3b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:08.113870 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e25d59f3-1e31-4c74-94e5-44d7a37b7c3b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:08.122108 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e25d59f3-1e31-4c74-94e5-44d7a37b7c3b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1293 microversion: 2.1 time: 0.084019 Jul 31 20:05:08.122671 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 394/776] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:08 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:08.495807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ecaf554a-9a88-4bfd-a375-a0ee113dc110 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:08.497109 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ecaf554a-9a88-4bfd-a375-a0ee113dc110 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:08.504192 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ecaf554a-9a88-4bfd-a375-a0ee113dc110 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:08.504955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ecaf554a-9a88-4bfd-a375-a0ee113dc110 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:08.505854 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ecaf554a-9a88-4bfd-a375-a0ee113dc110 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:08.506374 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ecaf554a-9a88-4bfd-a375-a0ee113dc110 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:08.643698 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ecaf554a-9a88-4bfd-a375-a0ee113dc110 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:08.651548 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ecaf554a-9a88-4bfd-a375-a0ee113dc110 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1507 microversion: 2.1 time: 0.160134 Jul 31 20:05:08.652146 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 383/777] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:08 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:09.142987 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a4afe452-f760-424a-b949-16de5ae5d830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:09.143563 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a4afe452-f760-424a-b949-16de5ae5d830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:09.150537 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4afe452-f760-424a-b949-16de5ae5d830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:09.150985 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4afe452-f760-424a-b949-16de5ae5d830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:09.151723 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4afe452-f760-424a-b949-16de5ae5d830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:09.152143 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4afe452-f760-424a-b949-16de5ae5d830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:09.215142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a4afe452-f760-424a-b949-16de5ae5d830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:09.225318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a4afe452-f760-424a-b949-16de5ae5d830 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1293 microversion: 2.1 time: 0.085829 Jul 31 20:05:09.225878 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 395/778] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:09 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:09.282611 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-d7f3fafa-1325-4581-9930-d7b8c72085e6 req-a8a27b5e-4a65-4050-a140-d21a630aaa27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6903e84-ecc4-4445-9058-df88ae4f3d2f", "tag": "5acf938b-5d35-458d-9e0d-0c6a46fac38e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:09.293774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d7f3fafa-1325-4581-9930-d7b8c72085e6 req-a8a27b5e-4a65-4050-a140-d21a630aaa27 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:09.294098 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d7f3fafa-1325-4581-9930-d7b8c72085e6 req-a8a27b5e-4a65-4050-a140-d21a630aaa27 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:09.305101 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-d7f3fafa-1325-4581-9930-d7b8c72085e6 req-a8a27b5e-4a65-4050-a140-d21a630aaa27 service nova] Creating event network-changed:5acf938b-5d35-458d-9e0d-0c6a46fac38e for instance c6903e84-ecc4-4445-9058-df88ae4f3d2f on hv-cinder-84984 Jul 31 20:05:09.310221 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-d7f3fafa-1325-4581-9930-d7b8c72085e6 req-a8a27b5e-4a65-4050-a140-d21a630aaa27 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032672 Jul 31 20:05:09.311252 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 384/779] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:09.672469 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2e4360d9-688b-4ee3-8d61-399e32e0d92e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:09.673432 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2e4360d9-688b-4ee3-8d61-399e32e0d92e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:09.680086 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e4360d9-688b-4ee3-8d61-399e32e0d92e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:09.680541 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e4360d9-688b-4ee3-8d61-399e32e0d92e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:09.681351 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e4360d9-688b-4ee3-8d61-399e32e0d92e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:09.681789 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e4360d9-688b-4ee3-8d61-399e32e0d92e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:09.813716 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2e4360d9-688b-4ee3-8d61-399e32e0d92e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:09.821446 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2e4360d9-688b-4ee3-8d61-399e32e0d92e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1507 microversion: 2.1 time: 0.153190 Jul 31 20:05:09.822003 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 396/780] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:09 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:10.249338 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-770940d5-33c0-438f-b489-798b6c433ddf tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:10.250652 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-770940d5-33c0-438f-b489-798b6c433ddf tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:10.259164 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-770940d5-33c0-438f-b489-798b6c433ddf tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:10.259678 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-770940d5-33c0-438f-b489-798b6c433ddf tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:10.260546 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-770940d5-33c0-438f-b489-798b6c433ddf tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:10.261069 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-770940d5-33c0-438f-b489-798b6c433ddf tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:10.409261 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-770940d5-33c0-438f-b489-798b6c433ddf tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:10.420537 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-770940d5-33c0-438f-b489-798b6c433ddf tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1301 microversion: 2.1 time: 0.176094 Jul 31 20:05:10.422330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 385/781] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:10 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1301 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:10.842546 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7077e55f-555c-4c4e-acef-3f30c26548e7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:10.843162 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7077e55f-555c-4c4e-acef-3f30c26548e7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:10.850236 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7077e55f-555c-4c4e-acef-3f30c26548e7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:10.850682 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7077e55f-555c-4c4e-acef-3f30c26548e7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:10.851448 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7077e55f-555c-4c4e-acef-3f30c26548e7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:10.851879 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7077e55f-555c-4c4e-acef-3f30c26548e7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:11.242695 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7077e55f-555c-4c4e-acef-3f30c26548e7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:11.251458 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7077e55f-555c-4c4e-acef-3f30c26548e7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1507 microversion: 2.1 time: 0.412703 Jul 31 20:05:11.252272 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 397/782] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:10 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:11.442806 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-30e69e99-a5e0-4d51-8c1f-6074eb4abb8b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:11.443425 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-30e69e99-a5e0-4d51-8c1f-6074eb4abb8b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:11.450387 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30e69e99-a5e0-4d51-8c1f-6074eb4abb8b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:11.450832 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30e69e99-a5e0-4d51-8c1f-6074eb4abb8b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:11.451763 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30e69e99-a5e0-4d51-8c1f-6074eb4abb8b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:11.452208 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30e69e99-a5e0-4d51-8c1f-6074eb4abb8b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:11.564873 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-30e69e99-a5e0-4d51-8c1f-6074eb4abb8b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:11.573112 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-30e69e99-a5e0-4d51-8c1f-6074eb4abb8b tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1299 microversion: 2.1 time: 0.134446 Jul 31 20:05:11.573957 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 386/783] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:11 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:11.670782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-630fa13b-e605-439c-9018-31df7602d091 req-c2f0d0b2-9012-4038-b84e-f362a840381a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecd0dfe-455d-48b5-bae6-6f0544738769", "name": "network-vif-deleted", "tag": "cfa02dcb-7408-495e-8b94-f4b8c7c96142"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:11.680770 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-630fa13b-e605-439c-9018-31df7602d091 req-c2f0d0b2-9012-4038-b84e-f362a840381a service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:11.681228 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-630fa13b-e605-439c-9018-31df7602d091 req-c2f0d0b2-9012-4038-b84e-f362a840381a service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:11.694836 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-630fa13b-e605-439c-9018-31df7602d091 req-c2f0d0b2-9012-4038-b84e-f362a840381a service nova] Creating event network-vif-deleted:cfa02dcb-7408-495e-8b94-f4b8c7c96142 for instance 8ecd0dfe-455d-48b5-bae6-6f0544738769 on hv-cinder-84984 Jul 31 20:05:11.700678 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-630fa13b-e605-439c-9018-31df7602d091 req-c2f0d0b2-9012-4038-b84e-f362a840381a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034270 Jul 31 20:05:11.702494 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 398/784] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:12.274158 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4a5aec02-1413-4efe-9e86-fedc600da478 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:12.274866 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4a5aec02-1413-4efe-9e86-fedc600da478 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:12.281571 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a5aec02-1413-4efe-9e86-fedc600da478 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:12.282092 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a5aec02-1413-4efe-9e86-fedc600da478 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:12.282876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a5aec02-1413-4efe-9e86-fedc600da478 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:12.283332 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a5aec02-1413-4efe-9e86-fedc600da478 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:12.287946 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:12.316956 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a5aec02-1413-4efe-9e86-fedc600da478 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:12.316956 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a5aec02-1413-4efe-9e86-fedc600da478 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:12.317331 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-4a5aec02-1413-4efe-9e86-fedc600da478 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lazy-loading 'fault' on Instance uuid 8ecd0dfe-455d-48b5-bae6-6f0544738769 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:05:12.360010 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4a5aec02-1413-4efe-9e86-fedc600da478 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:12.367635 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4a5aec02-1413-4efe-9e86-fedc600da478 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 200 len: 1311 microversion: 2.1 time: 0.097379 Jul 31 20:05:12.368176 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 387/785] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:12 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:12.595169 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-33e456a0-2522-477e-a886-d0c4e5290710 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:12.595773 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-33e456a0-2522-477e-a886-d0c4e5290710 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:12.602972 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33e456a0-2522-477e-a886-d0c4e5290710 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:12.603410 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33e456a0-2522-477e-a886-d0c4e5290710 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:12.604493 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33e456a0-2522-477e-a886-d0c4e5290710 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:12.604911 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33e456a0-2522-477e-a886-d0c4e5290710 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:12.822830 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-33e456a0-2522-477e-a886-d0c4e5290710 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:12.830922 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-33e456a0-2522-477e-a886-d0c4e5290710 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1367 microversion: 2.1 time: 0.240171 Jul 31 20:05:12.831701 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 399/786] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:12 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:13.390654 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2e53879d-7565-4ce0-a2ec-f68b48fbd0f7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:13.391217 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2e53879d-7565-4ce0-a2ec-f68b48fbd0f7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: 8ecd0dfe-455d-48b5-bae6-6f0544738769] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:13.398192 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e53879d-7565-4ce0-a2ec-f68b48fbd0f7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:13.398668 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e53879d-7565-4ce0-a2ec-f68b48fbd0f7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:13.399423 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e53879d-7565-4ce0-a2ec-f68b48fbd0f7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:13.399849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e53879d-7565-4ce0-a2ec-f68b48fbd0f7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:13.414114 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-2e53879d-7565-4ce0-a2ec-f68b48fbd0f7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] HTTP exception thrown: Instance 8ecd0dfe-455d-48b5-bae6-6f0544738769 could not be found. Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2e53879d-7565-4ce0-a2ec-f68b48fbd0f7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Request method failure captured: Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 HTTP/1.1 Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8wkAlbXsas087082cheCywlugC2lHFFc9iVqgo6_sBsR-YY5pZu5t-1nBKYhilL82c6N8gE1zCXnBGzizSkvsRiCQKIGfA7AeTxya_nSNWYEfiyYJL4ENUjFdbfKAqnXJ6B5iGF_OvnduRT1jdq2eFQLBjV9thklPR9a7cgSgtG9I Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 41f4d4561f4f40f8b370b8cc943c97af Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:05:13.415771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:05:13.417455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/41f4d4561f4f40f8b370b8cc943c97af"}]}] Jul 31 20:05:13.417455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:05:13.417455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 41f4d4561f4f40f8b370b8cc943c97af Jul 31 20:05:13.417455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:05:13.417455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-ServerRescueNegativeTestJSON-154903434-project Jul 31 20:05:13.417455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:05:13.417455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:05:13.417455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 89abc5820b584315a8413f6402f7ff1f Jul 31 20:05:13.417455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-154903434-project Jul 31 20:05:13.417455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:05:13.417455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance 8ecd0dfe-455d-48b5-bae6-6f0544738769 could not be found. Jul 31 20:05:13.417455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '8ecd0dfe-455d-48b5-bae6-6f0544738769'} Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ecd0dfe-455d-48b5-bae6-6f0544738769 could not be found. Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:05:13.418301 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ecd0dfe-455d-48b5-bae6-6f0544738769 could not be found. Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ecd0dfe-455d-48b5-bae6-6f0544738769 could not be found. Jul 31 20:05:13.419902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:13.421420 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2e53879d-7565-4ce0-a2ec-f68b48fbd0f7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Returning 404 to user: Instance 8ecd0dfe-455d-48b5-bae6-6f0544738769 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:05:13.421420 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2e53879d-7565-4ce0-a2ec-f68b48fbd0f7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769" status: 404 len: 111 microversion: 2.1 time: 0.032143 Jul 31 20:05:13.421420 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 388/787] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:13 2022] GET /compute/v2.1/servers/8ecd0dfe-455d-48b5-bae6-6f0544738769 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:05:13.426404 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-90a370bc-ec23-43c3-8d4e-d20306c1c44a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:13.426907 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-90a370bc-ec23-43c3-8d4e-d20306c1c44a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:13.433020 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90a370bc-ec23-43c3-8d4e-d20306c1c44a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:13.433570 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90a370bc-ec23-43c3-8d4e-d20306c1c44a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:13.434324 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90a370bc-ec23-43c3-8d4e-d20306c1c44a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:13.434780 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90a370bc-ec23-43c3-8d4e-d20306c1c44a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:13.449782 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:13.461415 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-90a370bc-ec23-43c3-8d4e-d20306c1c44a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:05:13.544068 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-90a370bc-ec23-43c3-8d4e-d20306c1c44a tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 204 len: 0 microversion: 2.1 time: 0.121223 Jul 31 20:05:13.544929 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 400/788] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:05:13 2022] DELETE /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:05:13.553087 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e8bac592-6877-4378-af0b-618983acb9ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:13.553949 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e8bac592-6877-4378-af0b-618983acb9ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:13.560066 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8bac592-6877-4378-af0b-618983acb9ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:13.560555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8bac592-6877-4378-af0b-618983acb9ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:13.561385 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8bac592-6877-4378-af0b-618983acb9ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:13.561826 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8bac592-6877-4378-af0b-618983acb9ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:13.719985 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e8bac592-6877-4378-af0b-618983acb9ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:13.729455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e8bac592-6877-4378-af0b-618983acb9ab tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.180349 Jul 31 20:05:13.730256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 389/789] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:13 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:13.794798 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-28671e31-2f63-40b2-89e8-2c6d06167c59 req-55413adc-9179-43d2-815f-43922b7d9012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa", "tag": "ea9ca6e8-81a9-4578-b567-6dc73d9650ec"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:13.809809 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-28671e31-2f63-40b2-89e8-2c6d06167c59 req-55413adc-9179-43d2-815f-43922b7d9012 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:13.810420 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-28671e31-2f63-40b2-89e8-2c6d06167c59 req-55413adc-9179-43d2-815f-43922b7d9012 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:13.820902 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-28671e31-2f63-40b2-89e8-2c6d06167c59 req-55413adc-9179-43d2-815f-43922b7d9012 service nova] Creating event network-changed:ea9ca6e8-81a9-4578-b567-6dc73d9650ec for instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa on hv-cinder-84984 Jul 31 20:05:13.825687 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-28671e31-2f63-40b2-89e8-2c6d06167c59 req-55413adc-9179-43d2-815f-43922b7d9012 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095475 Jul 31 20:05:13.826268 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 401/790] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:05:13.854306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b386c809-34d8-4604-bb23-45337fb2f00a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:13.854914 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b386c809-34d8-4604-bb23-45337fb2f00a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:13.861142 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b386c809-34d8-4604-bb23-45337fb2f00a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:13.861619 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b386c809-34d8-4604-bb23-45337fb2f00a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:13.862381 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b386c809-34d8-4604-bb23-45337fb2f00a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:13.862813 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b386c809-34d8-4604-bb23-45337fb2f00a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:14.001445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b386c809-34d8-4604-bb23-45337fb2f00a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:14.009097 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b386c809-34d8-4604-bb23-45337fb2f00a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1367 microversion: 2.1 time: 0.158682 Jul 31 20:05:14.009763 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 390/791] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:13 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:14.756741 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d3b20372-380d-4af8-a1e1-ff12466fe0b6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:14.758094 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d3b20372-380d-4af8-a1e1-ff12466fe0b6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:14.768633 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3b20372-380d-4af8-a1e1-ff12466fe0b6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:14.769416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3b20372-380d-4af8-a1e1-ff12466fe0b6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:14.770655 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3b20372-380d-4af8-a1e1-ff12466fe0b6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:14.771359 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3b20372-380d-4af8-a1e1-ff12466fe0b6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:14.916745 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d3b20372-380d-4af8-a1e1-ff12466fe0b6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:14.924735 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d3b20372-380d-4af8-a1e1-ff12466fe0b6 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.175789 Jul 31 20:05:14.925306 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 402/792] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:14 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:15.033961 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-50172bf7-105a-4e0c-b2b3-0ce1dd8bd795 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:15.034839 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-50172bf7-105a-4e0c-b2b3-0ce1dd8bd795 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:15.045711 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-50172bf7-105a-4e0c-b2b3-0ce1dd8bd795 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:15.046217 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-50172bf7-105a-4e0c-b2b3-0ce1dd8bd795 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:15.046981 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-50172bf7-105a-4e0c-b2b3-0ce1dd8bd795 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:15.047411 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-50172bf7-105a-4e0c-b2b3-0ce1dd8bd795 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:15.179045 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-50172bf7-105a-4e0c-b2b3-0ce1dd8bd795 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:15.186530 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-50172bf7-105a-4e0c-b2b3-0ce1dd8bd795 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1367 microversion: 2.1 time: 0.159207 Jul 31 20:05:15.187085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 391/793] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:15 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:15.952462 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6a0671bf-5c37-479d-a0cc-4461441ceb6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:15.952956 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6a0671bf-5c37-479d-a0cc-4461441ceb6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:15.955434 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:15.961142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a0671bf-5c37-479d-a0cc-4461441ceb6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:15.961678 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a0671bf-5c37-479d-a0cc-4461441ceb6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:15.962445 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a0671bf-5c37-479d-a0cc-4461441ceb6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:15.962874 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a0671bf-5c37-479d-a0cc-4461441ceb6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:16.098462 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6a0671bf-5c37-479d-a0cc-4461441ceb6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:16.105935 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6a0671bf-5c37-479d-a0cc-4461441ceb6e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.157697 Jul 31 20:05:16.106503 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 403/794] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:15 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:16.214485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7fec6ab2-8882-4e98-886f-68190462ad28 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:16.215514 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7fec6ab2-8882-4e98-886f-68190462ad28 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:16.218064 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:16.218728 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=10 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:16.224884 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fec6ab2-8882-4e98-886f-68190462ad28 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:16.225342 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fec6ab2-8882-4e98-886f-68190462ad28 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:16.226629 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fec6ab2-8882-4e98-886f-68190462ad28 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:16.226629 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fec6ab2-8882-4e98-886f-68190462ad28 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:16.364122 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7fec6ab2-8882-4e98-886f-68190462ad28 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:16.375989 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7fec6ab2-8882-4e98-886f-68190462ad28 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1367 microversion: 2.1 time: 0.170022 Jul 31 20:05:16.376810 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 392/795] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:16 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:17.131656 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b872bbb9-ff91-4c40-8577-247ed33b537b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:17.132659 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b872bbb9-ff91-4c40-8577-247ed33b537b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:17.142005 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b872bbb9-ff91-4c40-8577-247ed33b537b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:17.142453 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b872bbb9-ff91-4c40-8577-247ed33b537b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:17.143211 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b872bbb9-ff91-4c40-8577-247ed33b537b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:17.143639 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b872bbb9-ff91-4c40-8577-247ed33b537b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:17.287859 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b872bbb9-ff91-4c40-8577-247ed33b537b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:17.296289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b872bbb9-ff91-4c40-8577-247ed33b537b tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.171238 Jul 31 20:05:17.296827 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 404/796] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:17 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:17.402586 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ba5f1c52-9544-4aad-a535-ee295ca433b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:17.403279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ba5f1c52-9544-4aad-a535-ee295ca433b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:17.411395 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ba5f1c52-9544-4aad-a535-ee295ca433b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:17.411954 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ba5f1c52-9544-4aad-a535-ee295ca433b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:17.412817 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ba5f1c52-9544-4aad-a535-ee295ca433b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:17.413377 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ba5f1c52-9544-4aad-a535-ee295ca433b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:17.557582 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ba5f1c52-9544-4aad-a535-ee295ca433b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:17.565320 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ba5f1c52-9544-4aad-a535-ee295ca433b8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1367 microversion: 2.1 time: 0.167306 Jul 31 20:05:17.565897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 393/797] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:17 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:18.317803 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1227abd8-b365-4053-a992-83fef5013de7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:18.318335 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1227abd8-b365-4053-a992-83fef5013de7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:18.325262 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1227abd8-b365-4053-a992-83fef5013de7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:18.325698 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1227abd8-b365-4053-a992-83fef5013de7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:18.326449 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1227abd8-b365-4053-a992-83fef5013de7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:18.326874 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1227abd8-b365-4053-a992-83fef5013de7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:18.587744 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e1f924ed-49ae-4510-ac8f-d2fa57cbabc2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:18.588333 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e1f924ed-49ae-4510-ac8f-d2fa57cbabc2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:18.595495 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1f924ed-49ae-4510-ac8f-d2fa57cbabc2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:18.595977 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1f924ed-49ae-4510-ac8f-d2fa57cbabc2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:18.596740 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1f924ed-49ae-4510-ac8f-d2fa57cbabc2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:18.597191 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1f924ed-49ae-4510-ac8f-d2fa57cbabc2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:18.718382 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1227abd8-b365-4053-a992-83fef5013de7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:18.747997 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1227abd8-b365-4053-a992-83fef5013de7 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1521 microversion: 2.1 time: 0.434042 Jul 31 20:05:18.757204 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 405/798] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:18 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:18.936889 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e1f924ed-49ae-4510-ac8f-d2fa57cbabc2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:18.945396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e1f924ed-49ae-4510-ac8f-d2fa57cbabc2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1367 microversion: 2.1 time: 0.361599 Jul 31 20:05:18.945937 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 394/799] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:18 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1367 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:19.188719 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-a78a3bfc-26a5-4b1c-872f-c070fa991bb8 req-42e8712b-bcf4-482e-9fe4-127698f79655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a098dc51-df70-4d1b-ae0b-264fdb83e932", "name": "network-vif-deleted", "tag": "95267dcb-4338-43ed-96fe-5c4a8c8ee0dd"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:19.198740 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a78a3bfc-26a5-4b1c-872f-c070fa991bb8 req-42e8712b-bcf4-482e-9fe4-127698f79655 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:19.199169 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a78a3bfc-26a5-4b1c-872f-c070fa991bb8 req-42e8712b-bcf4-482e-9fe4-127698f79655 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:19.210384 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-a78a3bfc-26a5-4b1c-872f-c070fa991bb8 req-42e8712b-bcf4-482e-9fe4-127698f79655 service nova] Creating event network-vif-deleted:95267dcb-4338-43ed-96fe-5c4a8c8ee0dd for instance a098dc51-df70-4d1b-ae0b-264fdb83e932 on hv-cinder-84984 Jul 31 20:05:19.215198 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-a78a3bfc-26a5-4b1c-872f-c070fa991bb8 req-42e8712b-bcf4-482e-9fe4-127698f79655 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030146 Jul 31 20:05:19.215772 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 406/800] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:19.769463 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9951e883-5e56-4113-a6b7-fe32a9622200 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:19.770083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9951e883-5e56-4113-a6b7-fe32a9622200 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:19.776679 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9951e883-5e56-4113-a6b7-fe32a9622200 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:19.777662 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9951e883-5e56-4113-a6b7-fe32a9622200 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:19.778455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9951e883-5e56-4113-a6b7-fe32a9622200 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:19.778890 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9951e883-5e56-4113-a6b7-fe32a9622200 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:19.816932 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9951e883-5e56-4113-a6b7-fe32a9622200 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:19.817497 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9951e883-5e56-4113-a6b7-fe32a9622200 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:19.817998 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-9951e883-5e56-4113-a6b7-fe32a9622200 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lazy-loading 'fault' on Instance uuid a098dc51-df70-4d1b-ae0b-264fdb83e932 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:05:19.867038 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9951e883-5e56-4113-a6b7-fe32a9622200 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89abc5820b584315a8413f6402f7ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4d4561f4f40f8b370b8cc943c97af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:19.875610 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9951e883-5e56-4113-a6b7-fe32a9622200 tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 200 len: 1311 microversion: 2.1 time: 0.110008 Jul 31 20:05:19.876181 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 395/801] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:19 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:19.970766 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a8405c20-82a6-421c-9ae2-418e796f5dd3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:19.971481 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a8405c20-82a6-421c-9ae2-418e796f5dd3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:19.979264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8405c20-82a6-421c-9ae2-418e796f5dd3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:19.979787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8405c20-82a6-421c-9ae2-418e796f5dd3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:19.980675 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8405c20-82a6-421c-9ae2-418e796f5dd3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:19.981198 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8405c20-82a6-421c-9ae2-418e796f5dd3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:20.129483 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a8405c20-82a6-421c-9ae2-418e796f5dd3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:20.140241 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a8405c20-82a6-421c-9ae2-418e796f5dd3 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1367 microversion: 2.1 time: 0.176214 Jul 31 20:05:20.140800 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 407/802] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:19 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:20.897791 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-17f842e1-6fa0-44a0-bafb-042dd1ee850e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:20.898446 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-17f842e1-6fa0-44a0-bafb-042dd1ee850e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] [instance: a098dc51-df70-4d1b-ae0b-264fdb83e932] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:20.906235 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17f842e1-6fa0-44a0-bafb-042dd1ee850e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:20.906744 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17f842e1-6fa0-44a0-bafb-042dd1ee850e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:20.907576 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17f842e1-6fa0-44a0-bafb-042dd1ee850e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:20.908055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17f842e1-6fa0-44a0-bafb-042dd1ee850e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:20.923144 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-17f842e1-6fa0-44a0-bafb-042dd1ee850e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] HTTP exception thrown: Instance a098dc51-df70-4d1b-ae0b-264fdb83e932 could not be found. Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-17f842e1-6fa0-44a0-bafb-042dd1ee850e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Request method failure captured: Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 HTTP/1.1 Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8wkAlbXsas087082cheCywlugC2lHFFc9iVqgo6_sBsR-YY5pZu5t-1nBKYhilL82c6N8gE1zCXnBGzizSkvsRiCQKIGfA7AeTxya_nSNWYEfiyYJL4ENUjFdbfKAqnXJ6B5iGF_OvnduRT1jdq2eFQLBjV9thklPR9a7cgSgtG9I Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 41f4d4561f4f40f8b370b8cc943c97af Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:05:20.924657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:05:20.926083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_41f4d4561f4f40f8b370b8cc943c97af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/41f4d4561f4f40f8b370b8cc943c97af"}]}] Jul 31 20:05:20.926083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:05:20.926083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 41f4d4561f4f40f8b370b8cc943c97af Jul 31 20:05:20.926083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-154903434 Jul 31 20:05:20.926083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-ServerRescueNegativeTestJSON-154903434-project Jul 31 20:05:20.926083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:05:20.926083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:05:20.926083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 89abc5820b584315a8413f6402f7ff1f Jul 31 20:05:20.926083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-154903434-project Jul 31 20:05:20.926083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:05:20.926083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance a098dc51-df70-4d1b-ae0b-264fdb83e932 could not be found. Jul 31 20:05:20.926083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': 'a098dc51-df70-4d1b-ae0b-264fdb83e932'} Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a098dc51-df70-4d1b-ae0b-264fdb83e932 could not be found. Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:05:20.926795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a098dc51-df70-4d1b-ae0b-264fdb83e932 could not be found. Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a098dc51-df70-4d1b-ae0b-264fdb83e932 could not be found. Jul 31 20:05:20.927915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:05:20.929047 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-17f842e1-6fa0-44a0-bafb-042dd1ee850e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] Returning 404 to user: Instance a098dc51-df70-4d1b-ae0b-264fdb83e932 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:05:20.929047 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-17f842e1-6fa0-44a0-bafb-042dd1ee850e tempest-ServerRescueNegativeTestJSON-154903434 tempest-ServerRescueNegativeTestJSON-154903434-project] 10.222.0.48 "GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932" status: 404 len: 111 microversion: 2.1 time: 0.032695 Jul 31 20:05:20.929047 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 396/803] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:20 2022] GET /compute/v2.1/servers/a098dc51-df70-4d1b-ae0b-264fdb83e932 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:05:21.160632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8af435a1-6bbc-40e7-bf2d-a32dd9470477 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:21.161493 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8af435a1-6bbc-40e7-bf2d-a32dd9470477 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:21.168606 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8af435a1-6bbc-40e7-bf2d-a32dd9470477 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:21.169270 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8af435a1-6bbc-40e7-bf2d-a32dd9470477 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:21.170350 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8af435a1-6bbc-40e7-bf2d-a32dd9470477 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:21.170968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8af435a1-6bbc-40e7-bf2d-a32dd9470477 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:21.326873 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8af435a1-6bbc-40e7-bf2d-a32dd9470477 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:21.339920 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8af435a1-6bbc-40e7-bf2d-a32dd9470477 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1367 microversion: 2.1 time: 0.183703 Jul 31 20:05:21.340922 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-5b96d347-0039-44bf-be1d-deb818b39b82 req-9660fc4f-2b08-4f87-80ea-c58571856e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa", "name": "network-vif-plugged", "status": "completed", "tag": "ea9ca6e8-81a9-4578-b567-6dc73d9650ec"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:21.341980 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 408/804] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:21 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:21.352337 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5b96d347-0039-44bf-be1d-deb818b39b82 req-9660fc4f-2b08-4f87-80ea-c58571856e04 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:21.353014 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5b96d347-0039-44bf-be1d-deb818b39b82 req-9660fc4f-2b08-4f87-80ea-c58571856e04 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:21.366649 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-5b96d347-0039-44bf-be1d-deb818b39b82 req-9660fc4f-2b08-4f87-80ea-c58571856e04 service nova] Creating event network-vif-plugged:ea9ca6e8-81a9-4578-b567-6dc73d9650ec for instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa on hv-cinder-84984 Jul 31 20:05:21.373122 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-5b96d347-0039-44bf-be1d-deb818b39b82 req-9660fc4f-2b08-4f87-80ea-c58571856e04 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098486 Jul 31 20:05:21.373762 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 397/805] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:22.362366 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8a6fd57b-4128-424a-b2a6-2c1b4f20d4de tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:22.362976 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8a6fd57b-4128-424a-b2a6-2c1b4f20d4de tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:22.369845 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a6fd57b-4128-424a-b2a6-2c1b4f20d4de tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:22.370644 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a6fd57b-4128-424a-b2a6-2c1b4f20d4de tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:22.371406 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a6fd57b-4128-424a-b2a6-2c1b4f20d4de tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:22.371829 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a6fd57b-4128-424a-b2a6-2c1b4f20d4de tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:22.517235 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a6fd57b-4128-424a-b2a6-2c1b4f20d4de tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:22.525453 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8a6fd57b-4128-424a-b2a6-2c1b4f20d4de tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1367 microversion: 2.1 time: 0.167019 Jul 31 20:05:22.526522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 409/806] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:22 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:23.548861 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c1afe7d8-5bc6-4ffe-a9dc-e464a2aee4a0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:23.549930 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c1afe7d8-5bc6-4ffe-a9dc-e464a2aee4a0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:23.552467 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:23.560124 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1afe7d8-5bc6-4ffe-a9dc-e464a2aee4a0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:23.560924 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1afe7d8-5bc6-4ffe-a9dc-e464a2aee4a0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:23.561739 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1afe7d8-5bc6-4ffe-a9dc-e464a2aee4a0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:23.562181 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1afe7d8-5bc6-4ffe-a9dc-e464a2aee4a0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:23.721612 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c1afe7d8-5bc6-4ffe-a9dc-e464a2aee4a0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:23.748415 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c1afe7d8-5bc6-4ffe-a9dc-e464a2aee4a0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1557 microversion: 2.1 time: 0.205201 Jul 31 20:05:23.749288 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 398/807] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:23 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1557 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:23.774963 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e213eaf4-08e8-46ff-9d62-002b79891d9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:23.775519 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e213eaf4-08e8-46ff-9d62-002b79891d9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:23.786402 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e213eaf4-08e8-46ff-9d62-002b79891d9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:23.786850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e213eaf4-08e8-46ff-9d62-002b79891d9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:23.787792 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e213eaf4-08e8-46ff-9d62-002b79891d9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:23.788393 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e213eaf4-08e8-46ff-9d62-002b79891d9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:23.843874 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-30689602-eae1-4d27-9308-6e2c38af601b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:23.844743 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-30689602-eae1-4d27-9308-6e2c38af601b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:23.860962 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30689602-eae1-4d27-9308-6e2c38af601b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:23.861690 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30689602-eae1-4d27-9308-6e2c38af601b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:23.862811 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30689602-eae1-4d27-9308-6e2c38af601b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:23.863437 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30689602-eae1-4d27-9308-6e2c38af601b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:23.892854 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-30689602-eae1-4d27-9308-6e2c38af601b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/ips" status: 200 len: 152 microversion: 2.20 time: 0.052826 Jul 31 20:05:23.899582 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 399/808] 10.222.0.48 () {60 vars in 1289 bytes} [Sun Jul 31 20:05:23 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/ips => generated 152 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 20:05:23.900886 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e213eaf4-08e8-46ff-9d62-002b79891d9e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131912 Jul 31 20:05:23.901510 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 410/809] 10.222.0.48 () {58 vars in 1275 bytes} [Sun Jul 31 20:05:23 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:24.946379 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-ce344b81-995f-4bdf-b778-ed219d15109c req-84f9ad19-c7b0-45f8-8b2f-6af3b7d7d186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa", "tag": "ea9ca6e8-81a9-4578-b567-6dc73d9650ec"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:24.962739 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-ce344b81-995f-4bdf-b778-ed219d15109c req-84f9ad19-c7b0-45f8-8b2f-6af3b7d7d186 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:24.962739 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-ce344b81-995f-4bdf-b778-ed219d15109c req-84f9ad19-c7b0-45f8-8b2f-6af3b7d7d186 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:24.968782 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-ce344b81-995f-4bdf-b778-ed219d15109c req-84f9ad19-c7b0-45f8-8b2f-6af3b7d7d186 service nova] Creating event network-changed:ea9ca6e8-81a9-4578-b567-6dc73d9650ec for instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa on hv-cinder-84984 Jul 31 20:05:24.973757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-ce344b81-995f-4bdf-b778-ed219d15109c req-84f9ad19-c7b0-45f8-8b2f-6af3b7d7d186 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031037 Jul 31 20:05:24.974644 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 400/810] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:26.042520 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-edecd915-83f7-4b00-a19e-ab6561299ceb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:26.043068 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-edecd915-83f7-4b00-a19e-ab6561299ceb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:26.049495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-edecd915-83f7-4b00-a19e-ab6561299ceb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:26.049939 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-edecd915-83f7-4b00-a19e-ab6561299ceb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:26.050703 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-edecd915-83f7-4b00-a19e-ab6561299ceb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:26.051128 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-edecd915-83f7-4b00-a19e-ab6561299ceb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:26.074423 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-edecd915-83f7-4b00-a19e-ab6561299ceb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lazy-loading 'flavor' on Instance uuid 86192351-1ad0-4d52-8496-e85d6e5381dd {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:05:26.257288 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-edecd915-83f7-4b00-a19e-ab6561299ceb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "POST /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/action" status: 202 len: 0 microversion: 2.20 time: 0.219138 Jul 31 20:05:26.257869 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 411/811] 10.222.0.48 () {62 vars in 1319 bytes} [Sun Jul 31 20:05:26 2022] POST /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 31 20:05:26.268903 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fd0dad0c-3631-465c-a557-ef0339d602f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:26.269641 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fd0dad0c-3631-465c-a557-ef0339d602f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:26.276359 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd0dad0c-3631-465c-a557-ef0339d602f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:26.276844 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd0dad0c-3631-465c-a557-ef0339d602f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:26.277723 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd0dad0c-3631-465c-a557-ef0339d602f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:26.278239 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd0dad0c-3631-465c-a557-ef0339d602f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:26.417014 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fd0dad0c-3631-465c-a557-ef0339d602f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:26.428761 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fd0dad0c-3631-465c-a557-ef0339d602f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:26.430515 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fd0dad0c-3631-465c-a557-ef0339d602f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:26.432257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fd0dad0c-3631-465c-a557-ef0339d602f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.169343 Jul 31 20:05:26.433026 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 401/812] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:26 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:27.027297 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-70f2c601-d690-47b5-8dec-70ad207023dd tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] Calling method '.version_select at 0x7ffa24902790>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:27.075774 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-70f2c601-d690-47b5-8dec-70ad207023dd tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/54502bf6-20d9-44a2-8082-27e94d40220a" status: 200 len: 351 microversion: 2.1 time: 0.052725 Jul 31 20:05:27.076372 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 412/813] 10.222.0.48 () {58 vars in 1245 bytes} [Sun Jul 31 20:05:27 2022] GET /compute/v2.1/os-volumes/54502bf6-20d9-44a2-8082-27e94d40220a => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:27.457171 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a4898556-d10b-49cd-baea-60d9247bdec6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:27.457745 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a4898556-d10b-49cd-baea-60d9247bdec6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:27.464875 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4898556-d10b-49cd-baea-60d9247bdec6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:27.465348 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4898556-d10b-49cd-baea-60d9247bdec6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:27.466101 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4898556-d10b-49cd-baea-60d9247bdec6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:27.466527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4898556-d10b-49cd-baea-60d9247bdec6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:27.596997 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a4898556-d10b-49cd-baea-60d9247bdec6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:27.605324 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a4898556-d10b-49cd-baea-60d9247bdec6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:27.606815 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a4898556-d10b-49cd-baea-60d9247bdec6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:27.607957 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a4898556-d10b-49cd-baea-60d9247bdec6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.154812 Jul 31 20:05:27.608509 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 402/814] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:27 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:28.429019 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ea073530-042d-4959-93fa-1297fa4ee35d tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] Calling method '.version_select at 0x7ffa24699160>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:28.477130 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ea073530-042d-4959-93fa-1297fa4ee35d tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/562714aa-e90e-4696-8123-9d8197869dc3" status: 200 len: 350 microversion: 2.1 time: 0.052502 Jul 31 20:05:28.477741 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 413/815] 10.222.0.48 () {58 vars in 1245 bytes} [Sun Jul 31 20:05:28 2022] GET /compute/v2.1/os-volumes/562714aa-e90e-4696-8123-9d8197869dc3 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:28.631569 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f5b3007b-cc74-4a50-8963-7ddb06af480e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:28.632276 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f5b3007b-cc74-4a50-8963-7ddb06af480e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:28.639351 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f5b3007b-cc74-4a50-8963-7ddb06af480e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:28.640318 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f5b3007b-cc74-4a50-8963-7ddb06af480e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:28.641389 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f5b3007b-cc74-4a50-8963-7ddb06af480e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:28.642038 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f5b3007b-cc74-4a50-8963-7ddb06af480e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:28.801743 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f5b3007b-cc74-4a50-8963-7ddb06af480e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:28.810484 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f5b3007b-cc74-4a50-8963-7ddb06af480e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:28.812029 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f5b3007b-cc74-4a50-8963-7ddb06af480e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:28.813525 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f5b3007b-cc74-4a50-8963-7ddb06af480e tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.185710 Jul 31 20:05:28.814074 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 403/816] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:28 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:29.841998 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a5bf485-3d23-43e4-9cd2-ed22e9920707 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:29.842882 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a5bf485-3d23-43e4-9cd2-ed22e9920707 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:29.852987 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a5bf485-3d23-43e4-9cd2-ed22e9920707 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:29.853716 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a5bf485-3d23-43e4-9cd2-ed22e9920707 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:29.854830 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a5bf485-3d23-43e4-9cd2-ed22e9920707 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:29.855459 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a5bf485-3d23-43e4-9cd2-ed22e9920707 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:29.988058 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5493117c-74ed-40db-b4fa-1845a24ca39a tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] Calling method '.version_select at 0x7ffa24c4bee0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:29.996371 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a5bf485-3d23-43e4-9cd2-ed22e9920707 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:30.004492 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a5bf485-3d23-43e4-9cd2-ed22e9920707 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:30.006323 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a5bf485-3d23-43e4-9cd2-ed22e9920707 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:30.007230 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a5bf485-3d23-43e4-9cd2-ed22e9920707 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.172306 Jul 31 20:05:30.007813 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 414/817] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:29 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:30.038632 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5493117c-74ed-40db-b4fa-1845a24ca39a tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/3d388263-d571-4bf0-b545-0ed76c22575f" status: 200 len: 351 microversion: 2.1 time: 0.054905 Jul 31 20:05:30.039194 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 404/818] 10.222.0.48 () {58 vars in 1245 bytes} [Sun Jul 31 20:05:29 2022] GET /compute/v2.1/os-volumes/3d388263-d571-4bf0-b545-0ed76c22575f => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:05:30.051947 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d7959a7e-29f5-4132-8a1a-3c6bdc97bc45 tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] Calling method '.version_select at 0x7ffa246bab80>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:30.135451 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d7959a7e-29f5-4132-8a1a-3c6bdc97bc45 tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086911 Jul 31 20:05:30.136323 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 415/819] 10.222.0.48 () {58 vars in 1134 bytes} [Sun Jul 31 20:05:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:30.150153 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-49bb1bbb-0890-418b-a08a-6b72e4b3fad0 tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] Calling method '.version_select at 0x7ffa246a6a60>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:30.234958 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-49bb1bbb-0890-418b-a08a-6b72e4b3fad0 tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088526 Jul 31 20:05:30.235545 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 405/820] 10.222.0.48 () {58 vars in 1149 bytes} [Sun Jul 31 20:05:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:05:30.255020 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2877e26f-2cbb-4fe9-80ad-9d568782d22b tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] Calling method '.version_select at 0x7ffa246865e0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:30.335244 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2877e26f-2cbb-4fe9-80ad-9d568782d22b tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084299 Jul 31 20:05:30.336185 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 416/821] 10.222.0.48 () {58 vars in 1134 bytes} [Sun Jul 31 20:05:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:30.349068 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-55e1af4e-5111-4511-873b-803f6f351bad tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] Calling method '.version_select at 0x7ffa2484ce50>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:30.434283 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-55e1af4e-5111-4511-873b-803f6f351bad tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088925 Jul 31 20:05:30.434875 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 406/822] 10.222.0.48 () {58 vars in 1167 bytes} [Sun Jul 31 20:05:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:30.449372 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb0e812b-6fc0-40d4-ba6b-589fb6d5a6f2 tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] Calling method '.version_select at 0x7ffa2466a160>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:30.535124 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb0e812b-6fc0-40d4-ba6b-589fb6d5a6f2 tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089482 Jul 31 20:05:30.535708 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 417/823] 10.222.0.48 () {58 vars in 1170 bytes} [Sun Jul 31 20:05:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:30.549608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-01500c7d-5075-4e34-86f4-0020eb63fdcc tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] Calling method '.version_select at 0x7ffa245bd670>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:30.630800 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-01500c7d-5075-4e34-86f4-0020eb63fdcc tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085421 Jul 31 20:05:30.631363 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 407/824] 10.222.0.48 () {58 vars in 1155 bytes} [Sun Jul 31 20:05:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:30.647868 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-677efe34-fc2f-4855-8cc3-45bdec63032d tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] Calling method '.version_select at 0x7ffa246868b0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:30.728403 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-677efe34-fc2f-4855-8cc3-45bdec63032d tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084184 Jul 31 20:05:30.728960 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 418/825] 10.222.0.48 () {58 vars in 1188 bytes} [Sun Jul 31 20:05:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:30.744608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d91d67bf-41c4-43d1-b295-7d844417eb3b tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] Calling method '.version_select at 0x7ffa247cd0d0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:30.829507 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d91d67bf-41c4-43d1-b295-7d844417eb3b tempest-VolumesTestJSON-1702072497 tempest-VolumesTestJSON-1702072497-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088103 Jul 31 20:05:30.830056 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 408/826] 10.222.0.48 () {58 vars in 1155 bytes} [Sun Jul 31 20:05:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:31.031539 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-78cb6e5f-4e28-4639-b2ab-c45a3f387e56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:31.032225 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-78cb6e5f-4e28-4639-b2ab-c45a3f387e56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:31.039267 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-78cb6e5f-4e28-4639-b2ab-c45a3f387e56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:31.039719 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-78cb6e5f-4e28-4639-b2ab-c45a3f387e56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:31.040488 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-78cb6e5f-4e28-4639-b2ab-c45a3f387e56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:31.040921 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-78cb6e5f-4e28-4639-b2ab-c45a3f387e56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:31.171951 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-78cb6e5f-4e28-4639-b2ab-c45a3f387e56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:31.180184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-78cb6e5f-4e28-4639-b2ab-c45a3f387e56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:31.181763 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-78cb6e5f-4e28-4639-b2ab-c45a3f387e56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:31.182907 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-78cb6e5f-4e28-4639-b2ab-c45a3f387e56 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.155856 Jul 31 20:05:31.183523 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 419/827] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:31 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:32.209097 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-23dc8e03-0164-42dc-ab62-7cabf40e16fe tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:32.210502 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-23dc8e03-0164-42dc-ab62-7cabf40e16fe tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:32.220372 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-23dc8e03-0164-42dc-ab62-7cabf40e16fe tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:32.221217 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-23dc8e03-0164-42dc-ab62-7cabf40e16fe tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:32.222307 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-23dc8e03-0164-42dc-ab62-7cabf40e16fe tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:32.222821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-23dc8e03-0164-42dc-ab62-7cabf40e16fe tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:32.363792 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-23dc8e03-0164-42dc-ab62-7cabf40e16fe tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:32.373568 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-23dc8e03-0164-42dc-ab62-7cabf40e16fe tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:32.375065 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-23dc8e03-0164-42dc-ab62-7cabf40e16fe tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:32.376216 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-23dc8e03-0164-42dc-ab62-7cabf40e16fe tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.172880 Jul 31 20:05:32.376779 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 409/828] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:32 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:33.405220 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-41aa8f55-3c27-4132-b364-2a177aa821d3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:33.406067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-41aa8f55-3c27-4132-b364-2a177aa821d3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:33.413446 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41aa8f55-3c27-4132-b364-2a177aa821d3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:33.413883 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41aa8f55-3c27-4132-b364-2a177aa821d3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:33.414637 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41aa8f55-3c27-4132-b364-2a177aa821d3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:33.415059 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41aa8f55-3c27-4132-b364-2a177aa821d3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:33.563224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-41aa8f55-3c27-4132-b364-2a177aa821d3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:33.574876 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-41aa8f55-3c27-4132-b364-2a177aa821d3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:33.576613 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-41aa8f55-3c27-4132-b364-2a177aa821d3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:33.578312 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-41aa8f55-3c27-4132-b364-2a177aa821d3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.180149 Jul 31 20:05:33.579129 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 420/829] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:33 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:34.602122 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9662396b-a2cb-40d9-a102-267abbecce2b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:34.602815 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9662396b-a2cb-40d9-a102-267abbecce2b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:34.609604 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9662396b-a2cb-40d9-a102-267abbecce2b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:34.610262 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9662396b-a2cb-40d9-a102-267abbecce2b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:34.611022 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9662396b-a2cb-40d9-a102-267abbecce2b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:34.611447 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9662396b-a2cb-40d9-a102-267abbecce2b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:34.753178 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9662396b-a2cb-40d9-a102-267abbecce2b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:34.771581 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9662396b-a2cb-40d9-a102-267abbecce2b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:34.773065 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9662396b-a2cb-40d9-a102-267abbecce2b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:34.774232 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9662396b-a2cb-40d9-a102-267abbecce2b tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.176094 Jul 31 20:05:34.774773 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 410/830] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:34 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:35.797298 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-128ca385-770c-49a8-9b5f-2890f7316800 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:35.797966 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-128ca385-770c-49a8-9b5f-2890f7316800 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:35.800429 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:35.806538 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-128ca385-770c-49a8-9b5f-2890f7316800 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:35.806965 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-128ca385-770c-49a8-9b5f-2890f7316800 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:35.807748 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-128ca385-770c-49a8-9b5f-2890f7316800 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:35.808191 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-128ca385-770c-49a8-9b5f-2890f7316800 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:35.816776 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:35.952224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-128ca385-770c-49a8-9b5f-2890f7316800 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:35.963837 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-128ca385-770c-49a8-9b5f-2890f7316800 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:35.966234 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-128ca385-770c-49a8-9b5f-2890f7316800 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:35.967732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-128ca385-770c-49a8-9b5f-2890f7316800 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.174427 Jul 31 20:05:35.968443 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 421/831] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:35 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:36.991089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8622bd97-42f4-4a58-871d-65657cda5a0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:36.991643 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8622bd97-42f4-4a58-871d-65657cda5a0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:36.999264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8622bd97-42f4-4a58-871d-65657cda5a0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:36.999777 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8622bd97-42f4-4a58-871d-65657cda5a0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:37.000540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8622bd97-42f4-4a58-871d-65657cda5a0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:37.001044 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8622bd97-42f4-4a58-871d-65657cda5a0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:37.005439 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:37.140111 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8622bd97-42f4-4a58-871d-65657cda5a0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:37.148283 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8622bd97-42f4-4a58-871d-65657cda5a0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:37.149832 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8622bd97-42f4-4a58-871d-65657cda5a0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:37.150985 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8622bd97-42f4-4a58-871d-65657cda5a0f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.163898 Jul 31 20:05:37.151515 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 411/832] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:36 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:38.143879 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ffa1d37b-708f-45f5-a38a-d1b7119a1391 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-540683190"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:38.144429 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ffa1d37b-708f-45f5-a38a-d1b7119a1391 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:38.151904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffa1d37b-708f-45f5-a38a-d1b7119a1391 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:38.152379 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffa1d37b-708f-45f5-a38a-d1b7119a1391 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:38.153183 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffa1d37b-708f-45f5-a38a-d1b7119a1391 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:38.153675 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffa1d37b-708f-45f5-a38a-d1b7119a1391 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:38.174243 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f0df6f99-0fe7-40c7-a028-5c79d1ab9ab0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:38.174843 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f0df6f99-0fe7-40c7-a028-5c79d1ab9ab0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:38.181826 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0df6f99-0fe7-40c7-a028-5c79d1ab9ab0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:38.182274 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0df6f99-0fe7-40c7-a028-5c79d1ab9ab0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:38.183044 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0df6f99-0fe7-40c7-a028-5c79d1ab9ab0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:38.183473 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0df6f99-0fe7-40c7-a028-5c79d1ab9ab0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:38.334950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.network.security_group_api [None req-ffa1d37b-708f-45f5-a38a-d1b7119a1391 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Removing security group f39e97ea-e3c3-4f24-a5f7-e04513ad136d from port 635c81a2-0f42-4226-ac0b-56a4f733839f Jul 31 20:05:38.414705 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f0df6f99-0fe7-40c7-a028-5c79d1ab9ab0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:38.422980 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f0df6f99-0fe7-40c7-a028-5c79d1ab9ab0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:38.424455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f0df6f99-0fe7-40c7-a028-5c79d1ab9ab0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:38.425852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f0df6f99-0fe7-40c7-a028-5c79d1ab9ab0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.255595 Jul 31 20:05:38.427012 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 412/833] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:38 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:38.639495 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-68f67f67-1e8d-4662-a264-6e7105b2a384 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:38.639962 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-68f67f67-1e8d-4662-a264-6e7105b2a384 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:38.646092 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68f67f67-1e8d-4662-a264-6e7105b2a384 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:38.646575 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68f67f67-1e8d-4662-a264-6e7105b2a384 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:38.647334 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68f67f67-1e8d-4662-a264-6e7105b2a384 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:38.647770 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68f67f67-1e8d-4662-a264-6e7105b2a384 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:38.675010 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-68f67f67-1e8d-4662-a264-6e7105b2a384 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/ips" status: 200 len: 147 microversion: 2.1 time: 0.039407 Jul 31 20:05:38.675590 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 413/834] 10.222.0.48 () {58 vars in 1248 bytes} [Sun Jul 31 20:05:38 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:38.685072 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ffa1d37b-708f-45f5-a38a-d1b7119a1391 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "POST /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/action" status: 202 len: 0 microversion: 2.1 time: 0.546811 Jul 31 20:05:38.689327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 422/835] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:05:38 2022] POST /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:05:38.695940 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-5cb07871-829b-47fd-926a-5803d9658cde req-6555fb7a-17a0-4ce1-acae-2dd7943484f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f2c15d-f549-4688-887c-c6ae18ac1b39", "tag": "635c81a2-0f42-4226-ac0b-56a4f733839f"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:38.705830 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5cb07871-829b-47fd-926a-5803d9658cde req-6555fb7a-17a0-4ce1-acae-2dd7943484f8 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:38.706281 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5cb07871-829b-47fd-926a-5803d9658cde req-6555fb7a-17a0-4ce1-acae-2dd7943484f8 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:38.719569 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-5cb07871-829b-47fd-926a-5803d9658cde req-6555fb7a-17a0-4ce1-acae-2dd7943484f8 service nova] Creating event network-changed:635c81a2-0f42-4226-ac0b-56a4f733839f for instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 on hv-cinder-84984 Jul 31 20:05:38.725245 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-5cb07871-829b-47fd-926a-5803d9658cde req-6555fb7a-17a0-4ce1-acae-2dd7943484f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032852 Jul 31 20:05:38.726173 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 414/836] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:39.452546 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-26e0db65-2c76-4acb-9426-d62f1346b4fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:39.453184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-26e0db65-2c76-4acb-9426-d62f1346b4fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:39.460586 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26e0db65-2c76-4acb-9426-d62f1346b4fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:39.461390 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26e0db65-2c76-4acb-9426-d62f1346b4fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:39.462684 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26e0db65-2c76-4acb-9426-d62f1346b4fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:39.463207 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26e0db65-2c76-4acb-9426-d62f1346b4fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:39.620803 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-26e0db65-2c76-4acb-9426-d62f1346b4fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:39.630021 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-26e0db65-2c76-4acb-9426-d62f1346b4fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:39.630988 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-26e0db65-2c76-4acb-9426-d62f1346b4fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:39.632438 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-26e0db65-2c76-4acb-9426-d62f1346b4fd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.185319 Jul 31 20:05:39.633410 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 423/837] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:39 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:40.054149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-01f57bc0-8c28-46f3-b489-7af4ff337b3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:40.056855 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-01f57bc0-8c28-46f3-b489-7af4ff337b3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:40.067702 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01f57bc0-8c28-46f3-b489-7af4ff337b3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:40.068632 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01f57bc0-8c28-46f3-b489-7af4ff337b3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:40.069649 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01f57bc0-8c28-46f3-b489-7af4ff337b3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:40.070437 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01f57bc0-8c28-46f3-b489-7af4ff337b3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:40.173811 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-01f57bc0-8c28-46f3-b489-7af4ff337b3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lazy-loading 'services' on Instance uuid 71f2c15d-f549-4688-887c-c6ae18ac1b39 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:05:40.211484 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-c9f75a61-b6b8-4240-8cd8-f6c740aa1cb4 req-fc0282c0-b431-475b-ba8a-08c815b2cbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f2c15d-f549-4688-887c-c6ae18ac1b39", "tag": "635c81a2-0f42-4226-ac0b-56a4f733839f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:40.226025 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c9f75a61-b6b8-4240-8cd8-f6c740aa1cb4 req-fc0282c0-b431-475b-ba8a-08c815b2cbf3 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:40.226473 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c9f75a61-b6b8-4240-8cd8-f6c740aa1cb4 req-fc0282c0-b431-475b-ba8a-08c815b2cbf3 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:40.256167 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-c9f75a61-b6b8-4240-8cd8-f6c740aa1cb4 req-fc0282c0-b431-475b-ba8a-08c815b2cbf3 service nova] Creating event network-changed:635c81a2-0f42-4226-ac0b-56a4f733839f for instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 on hv-cinder-84984 Jul 31 20:05:40.262801 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-c9f75a61-b6b8-4240-8cd8-f6c740aa1cb4 req-fc0282c0-b431-475b-ba8a-08c815b2cbf3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213273 Jul 31 20:05:40.263507 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 424/838] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:05:40.274738 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e294164d-6b82-4d7d-8a4c-e28d354e01eb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1faae3bf-3146-4b2c-b218-4195c2016d07"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:40.277412 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e294164d-6b82-4d7d-8a4c-e28d354e01eb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:40.279462 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-01f57bc0-8c28-46f3-b489-7af4ff337b3d tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "DELETE /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/os-volume_attachments/ac3c38f0-9fdd-4940-9537-f626b2e0630a" status: 202 len: 0 microversion: 2.1 time: 0.232624 Jul 31 20:05:40.280289 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 415/839] 10.222.0.48 () {58 vars in 1416 bytes} [Sun Jul 31 20:05:40 2022] DELETE /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/os-volume_attachments/ac3c38f0-9fdd-4940-9537-f626b2e0630a => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:05:40.291608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bbf644d6-266e-47ef-b4e8-eaaf11d9c45a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:40.295417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bbf644d6-266e-47ef-b4e8-eaaf11d9c45a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:40.298517 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e294164d-6b82-4d7d-8a4c-e28d354e01eb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:40.299927 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e294164d-6b82-4d7d-8a4c-e28d354e01eb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:40.300976 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e294164d-6b82-4d7d-8a4c-e28d354e01eb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:40.301607 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e294164d-6b82-4d7d-8a4c-e28d354e01eb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:40.305042 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bbf644d6-266e-47ef-b4e8-eaaf11d9c45a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:40.306175 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bbf644d6-266e-47ef-b4e8-eaaf11d9c45a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:40.309002 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bbf644d6-266e-47ef-b4e8-eaaf11d9c45a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:40.310037 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bbf644d6-266e-47ef-b4e8-eaaf11d9c45a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:40.390491 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bbf644d6-266e-47ef-b4e8-eaaf11d9c45a tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103797 Jul 31 20:05:40.392892 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 416/840] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:05:40 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:40.666746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ba249b2e-977d-41d6-9777-c5bac5197880 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:40.667423 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ba249b2e-977d-41d6-9777-c5bac5197880 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:40.674826 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ba249b2e-977d-41d6-9777-c5bac5197880 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:40.675361 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ba249b2e-977d-41d6-9777-c5bac5197880 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:40.676232 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ba249b2e-977d-41d6-9777-c5bac5197880 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:40.676888 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ba249b2e-977d-41d6-9777-c5bac5197880 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:40.819986 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ba249b2e-977d-41d6-9777-c5bac5197880 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:40.832297 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ba249b2e-977d-41d6-9777-c5bac5197880 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:40.833842 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ba249b2e-977d-41d6-9777-c5bac5197880 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:40.835026 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ba249b2e-977d-41d6-9777-c5bac5197880 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.182847 Jul 31 20:05:40.849176 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 417/841] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:40 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:41.277360 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e294164d-6b82-4d7d-8a4c-e28d354e01eb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "POST /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.007974 Jul 31 20:05:41.278274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 425/842] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:05:40 2022] POST /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments => generated 194 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:41.404443 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4810e2f8-45ae-4ff5-a1da-8c65f95ca895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:41.406655 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4810e2f8-45ae-4ff5-a1da-8c65f95ca895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:41.416204 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4810e2f8-45ae-4ff5-a1da-8c65f95ca895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:41.416625 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4810e2f8-45ae-4ff5-a1da-8c65f95ca895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:41.417436 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4810e2f8-45ae-4ff5-a1da-8c65f95ca895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:41.417860 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4810e2f8-45ae-4ff5-a1da-8c65f95ca895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:41.446971 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4810e2f8-45ae-4ff5-a1da-8c65f95ca895 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046817 Jul 31 20:05:41.447515 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 418/843] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:05:41 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:41.859641 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-99c0f4b2-351d-4503-915e-3238a51f7def tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:41.860363 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-99c0f4b2-351d-4503-915e-3238a51f7def tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:41.867745 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99c0f4b2-351d-4503-915e-3238a51f7def tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:41.868184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99c0f4b2-351d-4503-915e-3238a51f7def tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:41.868940 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99c0f4b2-351d-4503-915e-3238a51f7def tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:41.869588 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99c0f4b2-351d-4503-915e-3238a51f7def tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:42.016353 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-99c0f4b2-351d-4503-915e-3238a51f7def tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:42.026069 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-99c0f4b2-351d-4503-915e-3238a51f7def tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:42.027680 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-99c0f4b2-351d-4503-915e-3238a51f7def tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:42.028858 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-99c0f4b2-351d-4503-915e-3238a51f7def tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1745 microversion: 2.20 time: 0.173732 Jul 31 20:05:42.029788 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 426/844] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:41 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:42.133624 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c73fd3be-bc61-4399-92ee-6eb3a8c473ec tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:42.134123 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c73fd3be-bc61-4399-92ee-6eb3a8c473ec tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:42.140292 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c73fd3be-bc61-4399-92ee-6eb3a8c473ec tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:42.140761 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c73fd3be-bc61-4399-92ee-6eb3a8c473ec tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:42.141551 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c73fd3be-bc61-4399-92ee-6eb3a8c473ec tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:42.141980 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c73fd3be-bc61-4399-92ee-6eb3a8c473ec tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:42.165409 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-c73fd3be-bc61-4399-92ee-6eb3a8c473ec tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lazy-loading 'flavor' on Instance uuid 9564a93e-d735-4c3b-916b-8e6c325e4b86 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:05:42.240315 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c73fd3be-bc61-4399-92ee-6eb3a8c473ec tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "POST /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86/action" status: 202 len: 0 microversion: 2.1 time: 0.110400 Jul 31 20:05:42.240872 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 419/845] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:05:42 2022] POST /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:05:42.249640 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9b85a058-06c0-43cc-943f-bb069085f3bb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:42.250247 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9b85a058-06c0-43cc-943f-bb069085f3bb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:42.257602 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b85a058-06c0-43cc-943f-bb069085f3bb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:42.258065 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b85a058-06c0-43cc-943f-bb069085f3bb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:42.258831 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b85a058-06c0-43cc-943f-bb069085f3bb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:42.259263 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b85a058-06c0-43cc-943f-bb069085f3bb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:42.407480 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b85a058-06c0-43cc-943f-bb069085f3bb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:42.415094 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9b85a058-06c0-43cc-943f-bb069085f3bb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1566 microversion: 2.1 time: 0.169712 Jul 31 20:05:42.415738 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 427/846] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:42 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:42.466337 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-eb1a6cf7-da6a-4422-bacc-729c14780506 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:42.469459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-eb1a6cf7-da6a-4422-bacc-729c14780506 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:42.476105 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb1a6cf7-da6a-4422-bacc-729c14780506 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:42.476546 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb1a6cf7-da6a-4422-bacc-729c14780506 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:42.477333 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb1a6cf7-da6a-4422-bacc-729c14780506 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:42.477763 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eb1a6cf7-da6a-4422-bacc-729c14780506 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:42.507038 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-eb1a6cf7-da6a-4422-bacc-729c14780506 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050461 Jul 31 20:05:42.507581 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 420/847] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:05:42 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 20:05:42.519480 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-26b12dcb-f59f-4979-ad1c-ce279008a9f1 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:42.519952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-26b12dcb-f59f-4979-ad1c-ce279008a9f1 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:42.526544 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26b12dcb-f59f-4979-ad1c-ce279008a9f1 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:42.526990 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26b12dcb-f59f-4979-ad1c-ce279008a9f1 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:42.527756 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26b12dcb-f59f-4979-ad1c-ce279008a9f1 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:42.528187 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26b12dcb-f59f-4979-ad1c-ce279008a9f1 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:42.606563 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-26b12dcb-f59f-4979-ad1c-ce279008a9f1 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] HTTP exception thrown: Instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 is not attached to volume ac3c38f0-9fdd-4940-9537-f626b2e0630a Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-26b12dcb-f59f-4979-ad1c-ce279008a9f1 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Request method failure captured: Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/os-volume_attachments/ac3c38f0-9fdd-4940-9537-f626b2e0630a HTTP/1.1 Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t_SIG4UxGhGuebQrboa-8oRhlvnxzj6nSeUzBbQgRcHa8G44F-SKxvbcIJRjwLAPa09nfnS8Npr8zEjMxxV5ZlwzGQ-MsgEBopX895vEUGeEpfkY3tIsAExCKiZ_jDvAmOYy74TXT1yKkSBnR2pTHICj7KoC5rO7U46_5wPPnDA2LI Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: a25221a81c1e49fbacdde74417e9a9c5 Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestMinimumBasicScenario-498957834 Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:05:42.614557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:05:42.616136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a25221a81c1e49fbacdde74417e9a9c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a25221a81c1e49fbacdde74417e9a9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a25221a81c1e49fbacdde74417e9a9c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a25221a81c1e49fbacdde74417e9a9c5"}]}] Jul 31 20:05:42.616136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestMinimumBasicScenario-498957834 Jul 31 20:05:42.616136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: a25221a81c1e49fbacdde74417e9a9c5 Jul 31 20:05:42.616136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestMinimumBasicScenario-498957834 Jul 31 20:05:42.616136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-TestMinimumBasicScenario-498957834-project Jul 31 20:05:42.616136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:05:42.616136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:05:42.616136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 80d3808785b345978fbe2e28a49e9f79 Jul 31 20:05:42.616136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestMinimumBasicScenario-498957834-project Jul 31 20:05:42.616136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:05:42.616136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 is not attached to volume ac3c38f0-9fdd-4940-9537-f626b2e0630a Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'server_id': '71f2c15d-f549-4688-887c-c6ae18ac1b39', 'id': 'ac3c38f0-9fdd-4940-9537-f626b2e0630a'} Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ac3c38f0-9fdd-4940-9537-f626b2e0630a. Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:05:42.617042 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 is not attached to volume ac3c38f0-9fdd-4940-9537-f626b2e0630a Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 is not attached to volume ac3c38f0-9fdd-4940-9537-f626b2e0630a Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:42.618584 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-26b12dcb-f59f-4979-ad1c-ce279008a9f1 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Returning 404 to user: Instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 is not attached to volume ac3c38f0-9fdd-4940-9537-f626b2e0630a {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:05:42.619745 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-26b12dcb-f59f-4979-ad1c-ce279008a9f1 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "DELETE /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/os-volume_attachments/ac3c38f0-9fdd-4940-9537-f626b2e0630a" status: 404 len: 154 microversion: 2.1 time: 0.101441 Jul 31 20:05:42.619745 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 428/848] 10.222.0.48 () {58 vars in 1416 bytes} [Sun Jul 31 20:05:42 2022] DELETE /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39/os-volume_attachments/ac3c38f0-9fdd-4940-9537-f626b2e0630a => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:05:43.053809 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f82fa6a9-042a-416b-b952-da2f7d881dac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:43.054409 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f82fa6a9-042a-416b-b952-da2f7d881dac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:43.060721 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f82fa6a9-042a-416b-b952-da2f7d881dac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:43.061206 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f82fa6a9-042a-416b-b952-da2f7d881dac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:43.061969 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f82fa6a9-042a-416b-b952-da2f7d881dac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:43.062456 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f82fa6a9-042a-416b-b952-da2f7d881dac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:43.206805 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f82fa6a9-042a-416b-b952-da2f7d881dac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:43.215393 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f82fa6a9-042a-416b-b952-da2f7d881dac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:43.216886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f82fa6a9-042a-416b-b952-da2f7d881dac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:43.218391 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f82fa6a9-042a-416b-b952-da2f7d881dac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1745 microversion: 2.20 time: 0.168570 Jul 31 20:05:43.219051 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 421/849] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:43 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:43.437696 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9de3c52e-9d51-406a-afb5-dbe36e44e4b4 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:43.438312 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9de3c52e-9d51-406a-afb5-dbe36e44e4b4 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:43.448640 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9de3c52e-9d51-406a-afb5-dbe36e44e4b4 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:43.450081 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9de3c52e-9d51-406a-afb5-dbe36e44e4b4 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:43.451551 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9de3c52e-9d51-406a-afb5-dbe36e44e4b4 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:43.452151 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9de3c52e-9d51-406a-afb5-dbe36e44e4b4 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:43.623367 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9de3c52e-9d51-406a-afb5-dbe36e44e4b4 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:43.631176 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9de3c52e-9d51-406a-afb5-dbe36e44e4b4 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1566 microversion: 2.1 time: 0.197462 Jul 31 20:05:43.632011 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 429/850] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:43 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:43.765499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b3dc7ece-497c-4e0f-8caf-162ef9e93d42 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:43.765990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b3dc7ece-497c-4e0f-8caf-162ef9e93d42 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:43.773261 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3dc7ece-497c-4e0f-8caf-162ef9e93d42 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:43.773715 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3dc7ece-497c-4e0f-8caf-162ef9e93d42 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:43.774468 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3dc7ece-497c-4e0f-8caf-162ef9e93d42 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:43.774900 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3dc7ece-497c-4e0f-8caf-162ef9e93d42 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:43.802406 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b3dc7ece-497c-4e0f-8caf-162ef9e93d42 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:05:43.890269 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b3dc7ece-497c-4e0f-8caf-162ef9e93d42 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "DELETE /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 204 len: 0 microversion: 2.1 time: 0.128322 Jul 31 20:05:43.890832 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 422/851] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:05:43 2022] DELETE /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:05:43.899605 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2af06724-414b-419b-910f-85515bfb4b0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:43.900910 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2af06724-414b-419b-910f-85515bfb4b0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:43.907618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2af06724-414b-419b-910f-85515bfb4b0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:43.908068 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2af06724-414b-419b-910f-85515bfb4b0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:43.908842 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2af06724-414b-419b-910f-85515bfb4b0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:43.909292 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2af06724-414b-419b-910f-85515bfb4b0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:44.039711 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2af06724-414b-419b-910f-85515bfb4b0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:44.048024 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2af06724-414b-419b-910f-85515bfb4b0e tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1554 microversion: 2.1 time: 0.152544 Jul 31 20:05:44.048570 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 430/852] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:43 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:44.242337 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-aa983c33-19b1-411a-83b4-3c21f74f22fb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:44.243058 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-aa983c33-19b1-411a-83b4-3c21f74f22fb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:44.250932 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa983c33-19b1-411a-83b4-3c21f74f22fb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:44.251369 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa983c33-19b1-411a-83b4-3c21f74f22fb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:44.252130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa983c33-19b1-411a-83b4-3c21f74f22fb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:44.252550 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa983c33-19b1-411a-83b4-3c21f74f22fb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:44.387044 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-aa983c33-19b1-411a-83b4-3c21f74f22fb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:44.395585 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-aa983c33-19b1-411a-83b4-3c21f74f22fb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:44.397052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-aa983c33-19b1-411a-83b4-3c21f74f22fb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:44.398244 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-aa983c33-19b1-411a-83b4-3c21f74f22fb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1745 microversion: 2.20 time: 0.160299 Jul 31 20:05:44.398813 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 423/853] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:44 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:44.716579 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0a80d197-a285-4bdb-8352-1a07824db26c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:44.717215 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0a80d197-a285-4bdb-8352-1a07824db26c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:44.723999 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a80d197-a285-4bdb-8352-1a07824db26c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:44.724443 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a80d197-a285-4bdb-8352-1a07824db26c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:44.725352 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a80d197-a285-4bdb-8352-1a07824db26c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:44.725781 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a80d197-a285-4bdb-8352-1a07824db26c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:44.865810 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0a80d197-a285-4bdb-8352-1a07824db26c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:44.875582 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0a80d197-a285-4bdb-8352-1a07824db26c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1566 microversion: 2.1 time: 0.163329 Jul 31 20:05:44.876288 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 431/854] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:44 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:45.072246 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-767918ec-a7e7-422a-aee9-72b21793f1a9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:45.072808 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-767918ec-a7e7-422a-aee9-72b21793f1a9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:45.081773 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-767918ec-a7e7-422a-aee9-72b21793f1a9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:45.082216 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-767918ec-a7e7-422a-aee9-72b21793f1a9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:45.082973 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-767918ec-a7e7-422a-aee9-72b21793f1a9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:45.083395 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-767918ec-a7e7-422a-aee9-72b21793f1a9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:45.101392 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:45.218972 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-767918ec-a7e7-422a-aee9-72b21793f1a9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:45.228440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-767918ec-a7e7-422a-aee9-72b21793f1a9 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1554 microversion: 2.1 time: 0.161906 Jul 31 20:05:45.229170 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 424/855] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:45 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:45.424711 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e04a02d9-5d11-4f83-9d40-ef59609d2f9c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:45.425370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e04a02d9-5d11-4f83-9d40-ef59609d2f9c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:45.431752 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e04a02d9-5d11-4f83-9d40-ef59609d2f9c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:45.432214 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e04a02d9-5d11-4f83-9d40-ef59609d2f9c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:45.433000 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e04a02d9-5d11-4f83-9d40-ef59609d2f9c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:45.433471 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e04a02d9-5d11-4f83-9d40-ef59609d2f9c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:45.550217 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-9b42010b-d50e-4a76-9b48-71fa45cd8eac req-22227b8e-e1df-4047-b261-f7ecb4f6ac4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86192351-1ad0-4d52-8496-e85d6e5381dd", "name": "network-vif-plugged", "status": "completed", "tag": "dc71e4bb-0c50-46be-9265-95e6a82b855e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:45.561945 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-9b42010b-d50e-4a76-9b48-71fa45cd8eac req-22227b8e-e1df-4047-b261-f7ecb4f6ac4c service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:45.562392 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-9b42010b-d50e-4a76-9b48-71fa45cd8eac req-22227b8e-e1df-4047-b261-f7ecb4f6ac4c service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:45.563865 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e04a02d9-5d11-4f83-9d40-ef59609d2f9c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:45.578958 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e04a02d9-5d11-4f83-9d40-ef59609d2f9c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:45.580989 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e04a02d9-5d11-4f83-9d40-ef59609d2f9c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:45.581770 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-9b42010b-d50e-4a76-9b48-71fa45cd8eac req-22227b8e-e1df-4047-b261-f7ecb4f6ac4c service nova] Creating event network-vif-plugged:dc71e4bb-0c50-46be-9265-95e6a82b855e for instance 86192351-1ad0-4d52-8496-e85d6e5381dd on hv-cinder-84984 Jul 31 20:05:45.582618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e04a02d9-5d11-4f83-9d40-ef59609d2f9c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1745 microversion: 2.20 time: 0.162199 Jul 31 20:05:45.583348 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 432/856] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:45 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:45.599832 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-9b42010b-d50e-4a76-9b48-71fa45cd8eac req-22227b8e-e1df-4047-b261-f7ecb4f6ac4c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053799 Jul 31 20:05:45.600805 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 425/857] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:45.897961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-163ffbf1-b36d-49f9-9cf3-c9dda2f98f1e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:45.898551 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-163ffbf1-b36d-49f9-9cf3-c9dda2f98f1e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:45.905980 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-163ffbf1-b36d-49f9-9cf3-c9dda2f98f1e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:45.906418 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-163ffbf1-b36d-49f9-9cf3-c9dda2f98f1e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:45.907310 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-163ffbf1-b36d-49f9-9cf3-c9dda2f98f1e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:45.907731 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-163ffbf1-b36d-49f9-9cf3-c9dda2f98f1e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:46.092073 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-163ffbf1-b36d-49f9-9cf3-c9dda2f98f1e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:46.101622 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-163ffbf1-b36d-49f9-9cf3-c9dda2f98f1e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1566 microversion: 2.1 time: 0.207540 Jul 31 20:05:46.102281 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 433/858] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:45 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:46.261202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d43b1569-a57a-484b-b1ab-edd342ecc610 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:46.262769 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d43b1569-a57a-484b-b1ab-edd342ecc610 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:46.271087 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d43b1569-a57a-484b-b1ab-edd342ecc610 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:46.271763 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d43b1569-a57a-484b-b1ab-edd342ecc610 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:46.272825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d43b1569-a57a-484b-b1ab-edd342ecc610 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:46.273547 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d43b1569-a57a-484b-b1ab-edd342ecc610 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:46.527008 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d43b1569-a57a-484b-b1ab-edd342ecc610 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d3808785b345978fbe2e28a49e9f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25221a81c1e49fbacdde74417e9a9c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:46.535708 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d43b1569-a57a-484b-b1ab-edd342ecc610 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 200 len: 1554 microversion: 2.1 time: 0.279752 Jul 31 20:05:46.536589 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 426/859] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:46 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 1554 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:46.608575 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-af9b24ea-d35a-4e59-824e-35e465dae8ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:46.609499 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-af9b24ea-d35a-4e59-824e-35e465dae8ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:46.616002 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af9b24ea-d35a-4e59-824e-35e465dae8ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:46.616682 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af9b24ea-d35a-4e59-824e-35e465dae8ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:46.617743 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af9b24ea-d35a-4e59-824e-35e465dae8ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:46.618489 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af9b24ea-d35a-4e59-824e-35e465dae8ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:46.663775 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-bdf37d2c-55df-4163-87b5-6430ada8fca5 req-e11143f8-9806-4ac4-bcf3-70ec69699b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f2c15d-f549-4688-887c-c6ae18ac1b39", "name": "network-vif-deleted", "tag": "635c81a2-0f42-4226-ac0b-56a4f733839f"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:46.678319 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-bdf37d2c-55df-4163-87b5-6430ada8fca5 req-e11143f8-9806-4ac4-bcf3-70ec69699b0a service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:46.678904 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-bdf37d2c-55df-4163-87b5-6430ada8fca5 req-e11143f8-9806-4ac4-bcf3-70ec69699b0a service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:46.713616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-bdf37d2c-55df-4163-87b5-6430ada8fca5 req-e11143f8-9806-4ac4-bcf3-70ec69699b0a service nova] Creating event network-vif-deleted:635c81a2-0f42-4226-ac0b-56a4f733839f for instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 on hv-cinder-84984 Jul 31 20:05:46.719337 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-bdf37d2c-55df-4163-87b5-6430ada8fca5 req-e11143f8-9806-4ac4-bcf3-70ec69699b0a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059586 Jul 31 20:05:46.720560 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 427/860] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:46.826880 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-af9b24ea-d35a-4e59-824e-35e465dae8ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:46.835961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-af9b24ea-d35a-4e59-824e-35e465dae8ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:46.841013 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-af9b24ea-d35a-4e59-824e-35e465dae8ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:46.842326 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-af9b24ea-d35a-4e59-824e-35e465dae8ea tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1740 microversion: 2.20 time: 0.238468 Jul 31 20:05:46.843097 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 434/861] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:46 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:47.125003 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ff1a219f-6545-4335-851e-172c1fc1da69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:47.125842 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ff1a219f-6545-4335-851e-172c1fc1da69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:47.132699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff1a219f-6545-4335-851e-172c1fc1da69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:47.133443 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff1a219f-6545-4335-851e-172c1fc1da69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:47.134468 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff1a219f-6545-4335-851e-172c1fc1da69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:47.135012 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff1a219f-6545-4335-851e-172c1fc1da69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:47.334960 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ff1a219f-6545-4335-851e-172c1fc1da69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:47.344614 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ff1a219f-6545-4335-851e-172c1fc1da69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1566 microversion: 2.1 time: 0.224200 Jul 31 20:05:47.361184 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 428/862] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:47 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:47.556266 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d6e4ca96-9db8-438d-aa4e-4c9afe5c6622 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:47.556873 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d6e4ca96-9db8-438d-aa4e-4c9afe5c6622 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] [instance: 71f2c15d-f549-4688-887c-c6ae18ac1b39] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:47.580123 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6e4ca96-9db8-438d-aa4e-4c9afe5c6622 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:47.580583 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6e4ca96-9db8-438d-aa4e-4c9afe5c6622 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:47.587785 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6e4ca96-9db8-438d-aa4e-4c9afe5c6622 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:47.588274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6e4ca96-9db8-438d-aa4e-4c9afe5c6622 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:47.620445 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-d6e4ca96-9db8-438d-aa4e-4c9afe5c6622 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] HTTP exception thrown: Instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 could not be found. Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d6e4ca96-9db8-438d-aa4e-4c9afe5c6622 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Request method failure captured: Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 HTTP/1.1 Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t_SIG4UxGhGuebQrboa-8oRhlvnxzj6nSeUzBbQgRcHa8G44F-SKxvbcIJRjwLAPa09nfnS8Npr8zEjMxxV5ZlwzGQ-MsgEBopX895vEUGeEpfkY3tIsAExCKiZ_jDvAmOYy74TXT1yKkSBnR2pTHICj7KoC5rO7U46_5wPPnDA2LI Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: a25221a81c1e49fbacdde74417e9a9c5 Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestMinimumBasicScenario-498957834 Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:05:47.623318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:05:47.624885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a25221a81c1e49fbacdde74417e9a9c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a25221a81c1e49fbacdde74417e9a9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a25221a81c1e49fbacdde74417e9a9c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a25221a81c1e49fbacdde74417e9a9c5"}]}] Jul 31 20:05:47.624885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestMinimumBasicScenario-498957834 Jul 31 20:05:47.624885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: a25221a81c1e49fbacdde74417e9a9c5 Jul 31 20:05:47.624885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestMinimumBasicScenario-498957834 Jul 31 20:05:47.624885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-TestMinimumBasicScenario-498957834-project Jul 31 20:05:47.624885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:05:47.624885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:05:47.624885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 80d3808785b345978fbe2e28a49e9f79 Jul 31 20:05:47.624885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestMinimumBasicScenario-498957834-project Jul 31 20:05:47.624885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:05:47.624885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 could not be found. Jul 31 20:05:47.624885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': '71f2c15d-f549-4688-887c-c6ae18ac1b39'} Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 could not be found. Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:05:47.625914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 could not be found. Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 could not be found. Jul 31 20:05:47.627787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:05:47.629285 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d6e4ca96-9db8-438d-aa4e-4c9afe5c6622 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Returning 404 to user: Instance 71f2c15d-f549-4688-887c-c6ae18ac1b39 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:05:47.630111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d6e4ca96-9db8-438d-aa4e-4c9afe5c6622 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39" status: 404 len: 111 microversion: 2.1 time: 0.077689 Jul 31 20:05:47.631032 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 435/863] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:47 2022] GET /compute/v2.1/servers/71f2c15d-f549-4688-887c-c6ae18ac1b39 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:05:47.644309 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-86ed6dc2-93cd-4475-89f2-b403e09dd837 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] Calling method '.version_select at 0x7ffa247fc280>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:47.670204 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-86ed6dc2-93cd-4475-89f2-b403e09dd837 tempest-TestMinimumBasicScenario-498957834 tempest-TestMinimumBasicScenario-498957834-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-636428792" status: 202 len: 0 microversion: 2.1 time: 0.034391 Jul 31 20:05:47.675021 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 429/864] 10.222.0.48 () {58 vars in 1269 bytes} [Sun Jul 31 20:05:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-636428792 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:05:47.868447 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b3a4696a-6031-436b-8720-69c51b1aad01 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:47.869080 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b3a4696a-6031-436b-8720-69c51b1aad01 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:47.876085 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3a4696a-6031-436b-8720-69c51b1aad01 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:47.876528 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3a4696a-6031-436b-8720-69c51b1aad01 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:47.877478 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3a4696a-6031-436b-8720-69c51b1aad01 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:47.877907 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3a4696a-6031-436b-8720-69c51b1aad01 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:48.083787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b3a4696a-6031-436b-8720-69c51b1aad01 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:48.097028 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b3a4696a-6031-436b-8720-69c51b1aad01 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:48.105987 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b3a4696a-6031-436b-8720-69c51b1aad01 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:48.107237 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b3a4696a-6031-436b-8720-69c51b1aad01 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1740 microversion: 2.20 time: 0.243170 Jul 31 20:05:48.107802 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 436/865] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:47 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:48.372311 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7bd6bc38-56d4-4bf4-bf75-5ff91a866c29 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:48.377613 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7bd6bc38-56d4-4bf4-bf75-5ff91a866c29 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:48.411817 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bd6bc38-56d4-4bf4-bf75-5ff91a866c29 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:48.412576 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bd6bc38-56d4-4bf4-bf75-5ff91a866c29 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:48.414043 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bd6bc38-56d4-4bf4-bf75-5ff91a866c29 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:48.416947 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bd6bc38-56d4-4bf4-bf75-5ff91a866c29 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:48.804135 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7bd6bc38-56d4-4bf4-bf75-5ff91a866c29 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:48.812024 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7bd6bc38-56d4-4bf4-bf75-5ff91a866c29 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1566 microversion: 2.1 time: 0.447398 Jul 31 20:05:48.813210 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 430/866] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:48 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1566 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:49.025714 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b4ddd652-87c4-4e5f-b6e0-965e5ae750c6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:49.028128 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b4ddd652-87c4-4e5f-b6e0-965e5ae750c6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:49.047338 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4ddd652-87c4-4e5f-b6e0-965e5ae750c6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:49.048074 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4ddd652-87c4-4e5f-b6e0-965e5ae750c6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:49.048954 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4ddd652-87c4-4e5f-b6e0-965e5ae750c6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:49.049424 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4ddd652-87c4-4e5f-b6e0-965e5ae750c6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:49.097537 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b4ddd652-87c4-4e5f-b6e0-965e5ae750c6 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075819 Jul 31 20:05:49.098910 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 437/867] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:05:49 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:49.109938 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6ab50f03-29ea-46cc-b820-010ccb7d63f4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:49.110722 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6ab50f03-29ea-46cc-b820-010ccb7d63f4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:49.118506 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ab50f03-29ea-46cc-b820-010ccb7d63f4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:49.118954 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ab50f03-29ea-46cc-b820-010ccb7d63f4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:49.119731 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ab50f03-29ea-46cc-b820-010ccb7d63f4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:49.120547 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ab50f03-29ea-46cc-b820-010ccb7d63f4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:49.136198 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e3929cdf-e3a8-49ec-9742-646f0ad44664 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:49.136840 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3929cdf-e3a8-49ec-9742-646f0ad44664 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:49.148155 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3929cdf-e3a8-49ec-9742-646f0ad44664 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:49.149089 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3929cdf-e3a8-49ec-9742-646f0ad44664 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:49.151575 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3929cdf-e3a8-49ec-9742-646f0ad44664 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:49.152266 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3929cdf-e3a8-49ec-9742-646f0ad44664 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:49.164549 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6ab50f03-29ea-46cc-b820-010ccb7d63f4 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments/1faae3bf-3146-4b2c-b218-4195c2016d07" status: 200 len: 194 microversion: 2.1 time: 0.058907 Jul 31 20:05:49.165184 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 431/868] 10.222.0.48 () {58 vars in 1413 bytes} [Sun Jul 31 20:05:49 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments/1faae3bf-3146-4b2c-b218-4195c2016d07 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:49.179223 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:49.684559 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3929cdf-e3a8-49ec-9742-646f0ad44664 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:49.694463 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3929cdf-e3a8-49ec-9742-646f0ad44664 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:49.696616 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3929cdf-e3a8-49ec-9742-646f0ad44664 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:49.698241 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e3929cdf-e3a8-49ec-9742-646f0ad44664 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1740 microversion: 2.20 time: 0.567425 Jul 31 20:05:49.699053 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 438/869] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:49 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1740 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:49.839622 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-60f0c34d-0ff5-4391-a2ea-6df1b42978bc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:49.841202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-60f0c34d-0ff5-4391-a2ea-6df1b42978bc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:49.849530 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60f0c34d-0ff5-4391-a2ea-6df1b42978bc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:49.850521 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60f0c34d-0ff5-4391-a2ea-6df1b42978bc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:49.852639 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60f0c34d-0ff5-4391-a2ea-6df1b42978bc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:49.853192 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60f0c34d-0ff5-4391-a2ea-6df1b42978bc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:50.068479 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-60f0c34d-0ff5-4391-a2ea-6df1b42978bc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:50.078224 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-60f0c34d-0ff5-4391-a2ea-6df1b42978bc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1566 microversion: 2.1 time: 0.245019 Jul 31 20:05:50.079151 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 432/870] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:49 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1566 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:50.668338 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-86b2ec2d-bd3c-4db4-82b1-35b6187db312 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86c7edc7-f53a-44b8-83ce-789b577c501c"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:50.670791 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-86b2ec2d-bd3c-4db4-82b1-35b6187db312 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:50.678544 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86b2ec2d-bd3c-4db4-82b1-35b6187db312 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:50.679013 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86b2ec2d-bd3c-4db4-82b1-35b6187db312 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:50.679793 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86b2ec2d-bd3c-4db4-82b1-35b6187db312 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:50.680220 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86b2ec2d-bd3c-4db4-82b1-35b6187db312 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:50.723656 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2650f2be-30d6-424b-90f9-4bcaecda672d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:50.728329 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2650f2be-30d6-424b-90f9-4bcaecda672d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:50.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2650f2be-30d6-424b-90f9-4bcaecda672d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:50.738212 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2650f2be-30d6-424b-90f9-4bcaecda672d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:50.739340 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2650f2be-30d6-424b-90f9-4bcaecda672d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:50.741704 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2650f2be-30d6-424b-90f9-4bcaecda672d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:51.079508 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2650f2be-30d6-424b-90f9-4bcaecda672d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:51.095853 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2650f2be-30d6-424b-90f9-4bcaecda672d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:51.099261 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2650f2be-30d6-424b-90f9-4bcaecda672d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:51.100463 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-86b2ec2d-bd3c-4db4-82b1-35b6187db312 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "POST /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.435925 Jul 31 20:05:51.101700 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 439/871] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:05:50 2022] POST /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:51.107196 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2650f2be-30d6-424b-90f9-4bcaecda672d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1740 microversion: 2.20 time: 0.384049 Jul 31 20:05:51.118323 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 433/872] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:50 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1740 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:05:51.128227 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4f04d553-11ff-49db-94fb-d9ea89c50132 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:51.141631 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4f04d553-11ff-49db-94fb-d9ea89c50132 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:51.164344 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f04d553-11ff-49db-94fb-d9ea89c50132 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:51.167010 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f04d553-11ff-49db-94fb-d9ea89c50132 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:51.168137 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f04d553-11ff-49db-94fb-d9ea89c50132 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:51.168572 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f04d553-11ff-49db-94fb-d9ea89c50132 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:51.486648 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4f04d553-11ff-49db-94fb-d9ea89c50132 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:51.496560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4f04d553-11ff-49db-94fb-d9ea89c50132 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1566 microversion: 2.1 time: 0.377828 Jul 31 20:05:51.512824 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 440/873] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:51 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1566 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:52.129171 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d7ba78fd-6fda-4849-b0cf-db9c8f4705c5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:52.130431 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d7ba78fd-6fda-4849-b0cf-db9c8f4705c5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:52.150148 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7ba78fd-6fda-4849-b0cf-db9c8f4705c5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:52.162021 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7ba78fd-6fda-4849-b0cf-db9c8f4705c5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:52.162882 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7ba78fd-6fda-4849-b0cf-db9c8f4705c5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:52.163586 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7ba78fd-6fda-4849-b0cf-db9c8f4705c5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:52.365938 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d7ba78fd-6fda-4849-b0cf-db9c8f4705c5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:52.385186 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d7ba78fd-6fda-4849-b0cf-db9c8f4705c5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:52.387742 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d7ba78fd-6fda-4849-b0cf-db9c8f4705c5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:52.392997 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d7ba78fd-6fda-4849-b0cf-db9c8f4705c5 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1740 microversion: 2.20 time: 0.268968 Jul 31 20:05:52.394074 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 434/874] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:52 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:52.524157 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-92d658f1-b005-4bb3-ab9d-9db558c3f5f0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:52.524929 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-92d658f1-b005-4bb3-ab9d-9db558c3f5f0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:52.538804 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92d658f1-b005-4bb3-ab9d-9db558c3f5f0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:52.539379 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92d658f1-b005-4bb3-ab9d-9db558c3f5f0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:52.547365 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92d658f1-b005-4bb3-ab9d-9db558c3f5f0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:52.550268 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92d658f1-b005-4bb3-ab9d-9db558c3f5f0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:52.866902 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-92d658f1-b005-4bb3-ab9d-9db558c3f5f0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:52.878684 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-92d658f1-b005-4bb3-ab9d-9db558c3f5f0 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1566 microversion: 2.1 time: 0.362090 Jul 31 20:05:52.881937 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 441/875] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:52 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1566 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:53.417723 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-973b1c27-c09e-4a07-a377-a790db245eb4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:53.418459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-973b1c27-c09e-4a07-a377-a790db245eb4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:53.426719 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-973b1c27-c09e-4a07-a377-a790db245eb4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:53.428047 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-973b1c27-c09e-4a07-a377-a790db245eb4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:53.429076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-973b1c27-c09e-4a07-a377-a790db245eb4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:53.429768 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-973b1c27-c09e-4a07-a377-a790db245eb4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:53.787812 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-973b1c27-c09e-4a07-a377-a790db245eb4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:53.800548 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-973b1c27-c09e-4a07-a377-a790db245eb4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:53.803156 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-973b1c27-c09e-4a07-a377-a790db245eb4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:53.804797 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-973b1c27-c09e-4a07-a377-a790db245eb4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1740 microversion: 2.20 time: 0.391541 Jul 31 20:05:53.828370 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 435/876] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:53 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1740 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:53.905283 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cbc1e2d2-db5f-4c40-86ac-5c87095fe8fc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:53.906749 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cbc1e2d2-db5f-4c40-86ac-5c87095fe8fc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:53.924276 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbc1e2d2-db5f-4c40-86ac-5c87095fe8fc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:53.924721 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbc1e2d2-db5f-4c40-86ac-5c87095fe8fc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:53.925549 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbc1e2d2-db5f-4c40-86ac-5c87095fe8fc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:53.925981 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbc1e2d2-db5f-4c40-86ac-5c87095fe8fc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:54.161697 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cbc1e2d2-db5f-4c40-86ac-5c87095fe8fc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:54.172720 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cbc1e2d2-db5f-4c40-86ac-5c87095fe8fc tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1566 microversion: 2.1 time: 0.271696 Jul 31 20:05:54.175703 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 442/877] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:53 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1566 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:54.838046 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c2071a7c-825b-44bf-9afa-60e684e62ee4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:54.838706 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c2071a7c-825b-44bf-9afa-60e684e62ee4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:54.840746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:54.850250 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2071a7c-825b-44bf-9afa-60e684e62ee4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:54.850796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2071a7c-825b-44bf-9afa-60e684e62ee4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:54.851812 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2071a7c-825b-44bf-9afa-60e684e62ee4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:54.852865 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2071a7c-825b-44bf-9afa-60e684e62ee4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:55.024587 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c2071a7c-825b-44bf-9afa-60e684e62ee4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:55.037580 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c2071a7c-825b-44bf-9afa-60e684e62ee4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:55.040034 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c2071a7c-825b-44bf-9afa-60e684e62ee4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:55.041558 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c2071a7c-825b-44bf-9afa-60e684e62ee4 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1740 microversion: 2.20 time: 0.212511 Jul 31 20:05:55.046879 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 436/878] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:54 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:55.196762 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a4c09878-f5ab-4d18-9951-4f483ea03610 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:55.198059 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a4c09878-f5ab-4d18-9951-4f483ea03610 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:55.208750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4c09878-f5ab-4d18-9951-4f483ea03610 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:55.217195 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4c09878-f5ab-4d18-9951-4f483ea03610 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:55.218289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4c09878-f5ab-4d18-9951-4f483ea03610 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:55.218961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4c09878-f5ab-4d18-9951-4f483ea03610 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:55.392447 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a4c09878-f5ab-4d18-9951-4f483ea03610 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:55.424512 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a4c09878-f5ab-4d18-9951-4f483ea03610 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1566 microversion: 2.1 time: 0.231517 Jul 31 20:05:55.426807 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 443/879] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:55 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:56.069238 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8c37830c-4d03-4a62-a83d-fc678b21f221 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:56.069849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8c37830c-4d03-4a62-a83d-fc678b21f221 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:56.097675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c37830c-4d03-4a62-a83d-fc678b21f221 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:56.098127 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c37830c-4d03-4a62-a83d-fc678b21f221 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:56.102031 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c37830c-4d03-4a62-a83d-fc678b21f221 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:56.102754 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c37830c-4d03-4a62-a83d-fc678b21f221 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:56.450005 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-10ed3b66-1992-4c3f-bd13-9e1084689c67 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:56.450833 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-10ed3b66-1992-4c3f-bd13-9e1084689c67 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:56.473530 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10ed3b66-1992-4c3f-bd13-9e1084689c67 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:56.474184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10ed3b66-1992-4c3f-bd13-9e1084689c67 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:56.475175 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10ed3b66-1992-4c3f-bd13-9e1084689c67 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:56.475889 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10ed3b66-1992-4c3f-bd13-9e1084689c67 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:56.633407 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8c37830c-4d03-4a62-a83d-fc678b21f221 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:56.646604 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8c37830c-4d03-4a62-a83d-fc678b21f221 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:56.648441 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8c37830c-4d03-4a62-a83d-fc678b21f221 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:56.649933 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8c37830c-4d03-4a62-a83d-fc678b21f221 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1740 microversion: 2.20 time: 0.584855 Jul 31 20:05:56.662286 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 437/880] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:56 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1740 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:56.928742 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-10ed3b66-1992-4c3f-bd13-9e1084689c67 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:56.941606 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-10ed3b66-1992-4c3f-bd13-9e1084689c67 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1567 microversion: 2.1 time: 0.497370 Jul 31 20:05:56.944038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 444/881] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:56 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1567 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:05:56.965085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-178043ac-acb1-43ff-900e-ca64ee1a0ea8 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:56.966005 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-178043ac-acb1-43ff-900e-ca64ee1a0ea8 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:56.976308 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-178043ac-acb1-43ff-900e-ca64ee1a0ea8 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:56.982612 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-178043ac-acb1-43ff-900e-ca64ee1a0ea8 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:56.986710 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-178043ac-acb1-43ff-900e-ca64ee1a0ea8 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:56.990957 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-178043ac-acb1-43ff-900e-ca64ee1a0ea8 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:57.059764 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-178043ac-acb1-43ff-900e-ca64ee1a0ea8 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117919) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 20:05:57.194595 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-178043ac-acb1-43ff-900e-ca64ee1a0ea8 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "POST /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86/action" status: 202 len: 0 microversion: 2.1 time: 0.234240 Jul 31 20:05:57.197736 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 438/882] 10.222.0.48 () {60 vars in 1278 bytes} [Sun Jul 31 20:05:56 2022] POST /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:05:57.206284 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7f102664-9333-4fa8-a7bb-0124e4a7bb38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:57.207603 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7f102664-9333-4fa8-a7bb-0124e4a7bb38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:57.226240 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f102664-9333-4fa8-a7bb-0124e4a7bb38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:57.226698 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f102664-9333-4fa8-a7bb-0124e4a7bb38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:57.228198 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f102664-9333-4fa8-a7bb-0124e4a7bb38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:57.230427 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f102664-9333-4fa8-a7bb-0124e4a7bb38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:57.550232 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7f102664-9333-4fa8-a7bb-0124e4a7bb38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:57.565333 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7f102664-9333-4fa8-a7bb-0124e4a7bb38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1515 microversion: 2.1 time: 0.360433 Jul 31 20:05:57.582736 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 445/883] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:57 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1515 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:57.685849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ff2e4b62-8676-4f66-a14d-cf216adc2235 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:57.686360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ff2e4b62-8676-4f66-a14d-cf216adc2235 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:57.703247 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff2e4b62-8676-4f66-a14d-cf216adc2235 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:57.707092 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff2e4b62-8676-4f66-a14d-cf216adc2235 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:57.717134 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff2e4b62-8676-4f66-a14d-cf216adc2235 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:57.720233 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff2e4b62-8676-4f66-a14d-cf216adc2235 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:58.210891 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ff2e4b62-8676-4f66-a14d-cf216adc2235 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:58.237059 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ff2e4b62-8676-4f66-a14d-cf216adc2235 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:58.239060 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ff2e4b62-8676-4f66-a14d-cf216adc2235 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:58.240278 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ff2e4b62-8676-4f66-a14d-cf216adc2235 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1740 microversion: 2.20 time: 0.560021 Jul 31 20:05:58.244243 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 439/884] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:57 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1740 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:58.588593 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-16b44381-049a-48a8-972d-5f78353e9efb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:58.589246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-16b44381-049a-48a8-972d-5f78353e9efb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:58.597207 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16b44381-049a-48a8-972d-5f78353e9efb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:58.597845 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16b44381-049a-48a8-972d-5f78353e9efb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:58.598803 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16b44381-049a-48a8-972d-5f78353e9efb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:58.599388 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16b44381-049a-48a8-972d-5f78353e9efb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:58.948756 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-16b44381-049a-48a8-972d-5f78353e9efb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:58.972517 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-16b44381-049a-48a8-972d-5f78353e9efb tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1517 microversion: 2.1 time: 0.388166 Jul 31 20:05:58.979066 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 446/885] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:58 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1517 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:05:59.053077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f7636ed4-ccfe-4534-ba8e-9bd7251819be tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:59.057099 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f7636ed4-ccfe-4534-ba8e-9bd7251819be tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:59.067972 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7636ed4-ccfe-4534-ba8e-9bd7251819be tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:59.068752 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7636ed4-ccfe-4534-ba8e-9bd7251819be tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:59.069790 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7636ed4-ccfe-4534-ba8e-9bd7251819be tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:59.070458 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7636ed4-ccfe-4534-ba8e-9bd7251819be tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:59.142250 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f7636ed4-ccfe-4534-ba8e-9bd7251819be tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.093969 Jul 31 20:05:59.143628 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 440/886] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:05:59 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:59.267301 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7dd87667-60a0-43ef-ac09-a0883d93e7d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:59.267919 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7dd87667-60a0-43ef-ac09-a0883d93e7d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:59.278703 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7dd87667-60a0-43ef-ac09-a0883d93e7d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:59.281054 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7dd87667-60a0-43ef-ac09-a0883d93e7d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:59.282834 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7dd87667-60a0-43ef-ac09-a0883d93e7d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:59.290020 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7dd87667-60a0-43ef-ac09-a0883d93e7d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:59.301509 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4c33bf8f-a737-4653-b05c-feb2a16d7133 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:59.302074 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4c33bf8f-a737-4653-b05c-feb2a16d7133 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:59.318581 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c33bf8f-a737-4653-b05c-feb2a16d7133 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:59.318935 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c33bf8f-a737-4653-b05c-feb2a16d7133 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:59.319730 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c33bf8f-a737-4653-b05c-feb2a16d7133 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:59.320169 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c33bf8f-a737-4653-b05c-feb2a16d7133 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:59.394312 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4c33bf8f-a737-4653-b05c-feb2a16d7133 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments/1faae3bf-3146-4b2c-b218-4195c2016d07" status: 200 len: 194 microversion: 2.1 time: 0.097594 Jul 31 20:05:59.396013 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 441/887] 10.222.0.48 () {58 vars in 1413 bytes} [Sun Jul 31 20:05:59 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments/1faae3bf-3146-4b2c-b218-4195c2016d07 => generated 194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:05:59.409428 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-840bd2b8-f982-404d-ac41-ab68dc9fb33d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:05:59.410369 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-840bd2b8-f982-404d-ac41-ab68dc9fb33d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:05:59.418354 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-840bd2b8-f982-404d-ac41-ab68dc9fb33d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:59.423049 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-840bd2b8-f982-404d-ac41-ab68dc9fb33d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:59.424231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-840bd2b8-f982-404d-ac41-ab68dc9fb33d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:59.424921 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-840bd2b8-f982-404d-ac41-ab68dc9fb33d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:59.504169 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:05:59.739362 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-840bd2b8-f982-404d-ac41-ab68dc9fb33d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lazy-loading 'services' on Instance uuid 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:05:59.844311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7dd87667-60a0-43ef-ac09-a0883d93e7d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:59.861456 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7dd87667-60a0-43ef-ac09-a0883d93e7d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:59.866349 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7dd87667-60a0-43ef-ac09-a0883d93e7d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:05:59.868988 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7dd87667-60a0-43ef-ac09-a0883d93e7d9 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1740 microversion: 2.20 time: 0.606089 Jul 31 20:05:59.886793 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 447/888] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:05:59 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1740 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:05:59.897814 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-054defa3-0e47-4d33-a8d0-a401890891fb req-037cda74-db3b-4f7f-abdc-cd63560b628d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9564a93e-d735-4c3b-916b-8e6c325e4b86", "name": "network-vif-unplugged", "status": "completed", "tag": "5404fa72-b0c7-496c-a13f-4c664ba48b5c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:05:59.930346 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-054defa3-0e47-4d33-a8d0-a401890891fb req-037cda74-db3b-4f7f-abdc-cd63560b628d service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:05:59.931065 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-054defa3-0e47-4d33-a8d0-a401890891fb req-037cda74-db3b-4f7f-abdc-cd63560b628d service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:05:59.933290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-840bd2b8-f982-404d-ac41-ab68dc9fb33d tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments/1faae3bf-3146-4b2c-b218-4195c2016d07" status: 202 len: 0 microversion: 2.1 time: 0.530844 Jul 31 20:05:59.946499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 442/889] 10.222.0.48 () {58 vars in 1416 bytes} [Sun Jul 31 20:05:59 2022] DELETE /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments/1faae3bf-3146-4b2c-b218-4195c2016d07 => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:05:59.961221 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.compute.server_external_events [req-054defa3-0e47-4d33-a8d0-a401890891fb req-037cda74-db3b-4f7f-abdc-cd63560b628d service nova] Unable to find a host for instance 9564a93e-d735-4c3b-916b-8e6c325e4b86. Dropping event network-vif-unplugged {{(pid=117920) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 31 20:05:59.968519 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-054defa3-0e47-4d33-a8d0-a401890891fb req-037cda74-db3b-4f7f-abdc-cd63560b628d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.080320 Jul 31 20:05:59.977883 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 448/890] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 90 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 31 20:06:00.001745 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-18c4925d-29c9-4768-851f-3b5c98d7375b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:00.002455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-18c4925d-29c9-4768-851f-3b5c98d7375b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:00.019255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18c4925d-29c9-4768-851f-3b5c98d7375b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:00.025506 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18c4925d-29c9-4768-851f-3b5c98d7375b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:00.032176 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18c4925d-29c9-4768-851f-3b5c98d7375b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:00.032988 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18c4925d-29c9-4768-851f-3b5c98d7375b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:00.363377 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-18c4925d-29c9-4768-851f-3b5c98d7375b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:00.372357 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-18c4925d-29c9-4768-851f-3b5c98d7375b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.374977 Jul 31 20:06:00.372927 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 443/891] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:05:59 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:00.899871 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fcbb380a-6005-4ee8-a8b2-55c4c0b0d750 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:00.900485 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fcbb380a-6005-4ee8-a8b2-55c4c0b0d750 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:00.907920 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcbb380a-6005-4ee8-a8b2-55c4c0b0d750 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:00.908355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcbb380a-6005-4ee8-a8b2-55c4c0b0d750 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:00.909136 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcbb380a-6005-4ee8-a8b2-55c4c0b0d750 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:00.909596 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcbb380a-6005-4ee8-a8b2-55c4c0b0d750 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:01.069482 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fcbb380a-6005-4ee8-a8b2-55c4c0b0d750 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:01.077534 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fcbb380a-6005-4ee8-a8b2-55c4c0b0d750 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:01.079049 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fcbb380a-6005-4ee8-a8b2-55c4c0b0d750 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:01.080671 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fcbb380a-6005-4ee8-a8b2-55c4c0b0d750 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1740 microversion: 2.20 time: 0.184678 Jul 31 20:06:01.081448 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 449/892] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:00 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:01.403033 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4d5697b2-dc9d-4274-aa59-69bc2b0d2611 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:01.403644 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4d5697b2-dc9d-4274-aa59-69bc2b0d2611 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:01.412671 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4d5697b2-dc9d-4274-aa59-69bc2b0d2611 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:01.413102 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4d5697b2-dc9d-4274-aa59-69bc2b0d2611 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:01.414079 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4d5697b2-dc9d-4274-aa59-69bc2b0d2611 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:01.414520 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4d5697b2-dc9d-4274-aa59-69bc2b0d2611 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:01.691676 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4d5697b2-dc9d-4274-aa59-69bc2b0d2611 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:01.702697 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4d5697b2-dc9d-4274-aa59-69bc2b0d2611 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.305848 Jul 31 20:06:01.703281 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 444/893] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:01 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:02.110705 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02010817-ee21-4f35-adf2-178f5d249b39 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:02.111556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-02010817-ee21-4f35-adf2-178f5d249b39 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:02.118927 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02010817-ee21-4f35-adf2-178f5d249b39 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:02.119372 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02010817-ee21-4f35-adf2-178f5d249b39 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:02.120475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02010817-ee21-4f35-adf2-178f5d249b39 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:02.120918 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02010817-ee21-4f35-adf2-178f5d249b39 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:02.188790 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a2579c61-74b9-4e11-836e-52bdd586f83c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:02.189500 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a2579c61-74b9-4e11-836e-52bdd586f83c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:02.195940 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2579c61-74b9-4e11-836e-52bdd586f83c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:02.196477 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2579c61-74b9-4e11-836e-52bdd586f83c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:02.197385 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2579c61-74b9-4e11-836e-52bdd586f83c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:02.197877 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2579c61-74b9-4e11-836e-52bdd586f83c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:02.227888 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a2579c61-74b9-4e11-836e-52bdd586f83c tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments/86c7edc7-f53a-44b8-83ce-789b577c501c" status: 200 len: 194 microversion: 2.1 time: 0.043145 Jul 31 20:06:02.228576 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 445/894] 10.222.0.48 () {58 vars in 1413 bytes} [Sun Jul 31 20:06:02 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments/86c7edc7-f53a-44b8-83ce-789b577c501c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:02.238936 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b3b01cb9-9f03-40ec-ade0-19db4d7bd2c3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:02.239441 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b3b01cb9-9f03-40ec-ade0-19db4d7bd2c3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:02.245919 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3b01cb9-9f03-40ec-ade0-19db4d7bd2c3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:02.246359 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3b01cb9-9f03-40ec-ade0-19db4d7bd2c3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:02.247116 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3b01cb9-9f03-40ec-ade0-19db4d7bd2c3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:02.247538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3b01cb9-9f03-40ec-ade0-19db4d7bd2c3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:02.258972 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02010817-ee21-4f35-adf2-178f5d249b39 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:02.267219 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02010817-ee21-4f35-adf2-178f5d249b39 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:02.268752 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02010817-ee21-4f35-adf2-178f5d249b39 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:02.269909 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-02010817-ee21-4f35-adf2-178f5d249b39 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1722 microversion: 2.20 time: 0.167891 Jul 31 20:06:02.270645 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 450/895] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:02 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:02.327460 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-b3b01cb9-9f03-40ec-ade0-19db4d7bd2c3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lazy-loading 'services' on Instance uuid 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:06:02.406753 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b3b01cb9-9f03-40ec-ade0-19db4d7bd2c3 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments/86c7edc7-f53a-44b8-83ce-789b577c501c" status: 202 len: 0 microversion: 2.1 time: 0.171529 Jul 31 20:06:02.407513 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 446/896] 10.222.0.48 () {58 vars in 1416 bytes} [Sun Jul 31 20:06:02 2022] DELETE /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments/86c7edc7-f53a-44b8-83ce-789b577c501c => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 20:06:02.725581 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8c9e325a-dc6d-4a22-93e8-79c2d1b8d18e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:02.726122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8c9e325a-dc6d-4a22-93e8-79c2d1b8d18e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:02.732515 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c9e325a-dc6d-4a22-93e8-79c2d1b8d18e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:02.732959 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c9e325a-dc6d-4a22-93e8-79c2d1b8d18e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:02.733768 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c9e325a-dc6d-4a22-93e8-79c2d1b8d18e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:02.734200 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c9e325a-dc6d-4a22-93e8-79c2d1b8d18e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:02.871498 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8c9e325a-dc6d-4a22-93e8-79c2d1b8d18e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:02.879560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8c9e325a-dc6d-4a22-93e8-79c2d1b8d18e tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.157989 Jul 31 20:06:02.880102 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 451/897] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:02 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:03.293881 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b54abd6-6e25-4929-8bb8-bfd4d456bfac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:03.294519 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7b54abd6-6e25-4929-8bb8-bfd4d456bfac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:03.301450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b54abd6-6e25-4929-8bb8-bfd4d456bfac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:03.301897 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b54abd6-6e25-4929-8bb8-bfd4d456bfac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:03.302661 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b54abd6-6e25-4929-8bb8-bfd4d456bfac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:03.303091 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b54abd6-6e25-4929-8bb8-bfd4d456bfac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:03.449604 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7b54abd6-6e25-4929-8bb8-bfd4d456bfac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:03.458247 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7b54abd6-6e25-4929-8bb8-bfd4d456bfac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:03.459725 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7b54abd6-6e25-4929-8bb8-bfd4d456bfac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:03.460836 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7b54abd6-6e25-4929-8bb8-bfd4d456bfac tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1722 microversion: 2.20 time: 0.171941 Jul 31 20:06:03.461442 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 447/898] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:03 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:03.903468 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-13146bd1-19d7-4f48-b586-63f445bc90bd tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:03.904273 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-13146bd1-19d7-4f48-b586-63f445bc90bd tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:03.912095 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13146bd1-19d7-4f48-b586-63f445bc90bd tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:03.912541 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13146bd1-19d7-4f48-b586-63f445bc90bd tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:03.913326 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13146bd1-19d7-4f48-b586-63f445bc90bd tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:03.913877 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13146bd1-19d7-4f48-b586-63f445bc90bd tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:04.045692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-13146bd1-19d7-4f48-b586-63f445bc90bd tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:04.053654 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-13146bd1-19d7-4f48-b586-63f445bc90bd tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.155510 Jul 31 20:06:04.054227 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 452/899] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:03 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:04.487994 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-28a056ce-ca65-43ea-80e4-f95d26924658 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:04.488981 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-28a056ce-ca65-43ea-80e4-f95d26924658 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:04.501011 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28a056ce-ca65-43ea-80e4-f95d26924658 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:04.501810 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28a056ce-ca65-43ea-80e4-f95d26924658 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:04.503061 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28a056ce-ca65-43ea-80e4-f95d26924658 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:04.503770 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28a056ce-ca65-43ea-80e4-f95d26924658 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:04.764635 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-28a056ce-ca65-43ea-80e4-f95d26924658 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:04.777038 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-28a056ce-ca65-43ea-80e4-f95d26924658 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:04.779411 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-28a056ce-ca65-43ea-80e4-f95d26924658 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:04.781081 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-28a056ce-ca65-43ea-80e4-f95d26924658 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1722 microversion: 2.20 time: 0.299556 Jul 31 20:06:04.781966 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 448/900] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:04 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:05.074888 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9a9862a7-e8ec-441e-b1da-b91d33442345 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:05.075769 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9a9862a7-e8ec-441e-b1da-b91d33442345 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:05.082292 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9862a7-e8ec-441e-b1da-b91d33442345 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:05.082726 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9862a7-e8ec-441e-b1da-b91d33442345 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:05.083492 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9862a7-e8ec-441e-b1da-b91d33442345 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:05.083914 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9862a7-e8ec-441e-b1da-b91d33442345 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:05.218221 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9a9862a7-e8ec-441e-b1da-b91d33442345 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:05.229662 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9a9862a7-e8ec-441e-b1da-b91d33442345 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.158481 Jul 31 20:06:05.230317 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 453/901] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:05 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:05.767924 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-77f32d5a-2d32-47da-a21a-dece63a742d2 req-a981a772-0ea5-4829-a3af-1876a02d74f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86192351-1ad0-4d52-8496-e85d6e5381dd", "name": "network-vif-unplugged", "status": "completed", "tag": "dc71e4bb-0c50-46be-9265-95e6a82b855e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:06:05.778789 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-77f32d5a-2d32-47da-a21a-dece63a742d2 req-a981a772-0ea5-4829-a3af-1876a02d74f4 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:05.779334 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-77f32d5a-2d32-47da-a21a-dece63a742d2 req-a981a772-0ea5-4829-a3af-1876a02d74f4 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:05.794052 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-77f32d5a-2d32-47da-a21a-dece63a742d2 req-a981a772-0ea5-4829-a3af-1876a02d74f4 service nova] Creating event network-vif-unplugged:dc71e4bb-0c50-46be-9265-95e6a82b855e for instance 86192351-1ad0-4d52-8496-e85d6e5381dd on hv-cinder-84984 Jul 31 20:06:05.799479 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-77f32d5a-2d32-47da-a21a-dece63a742d2 req-a981a772-0ea5-4829-a3af-1876a02d74f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035162 Jul 31 20:06:05.800210 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 449/902] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:05.804678 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9292bad9-c071-40bd-b00a-957f03e450f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:05.805320 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9292bad9-c071-40bd-b00a-957f03e450f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:05.811570 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9292bad9-c071-40bd-b00a-957f03e450f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:05.812012 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9292bad9-c071-40bd-b00a-957f03e450f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:05.812763 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9292bad9-c071-40bd-b00a-957f03e450f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:05.813244 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9292bad9-c071-40bd-b00a-957f03e450f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:05.816216 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:06:05.950797 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9292bad9-c071-40bd-b00a-957f03e450f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:05.961534 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9292bad9-c071-40bd-b00a-957f03e450f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:05.962940 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9292bad9-c071-40bd-b00a-957f03e450f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:05.964089 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9292bad9-c071-40bd-b00a-957f03e450f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1722 microversion: 2.20 time: 0.163733 Jul 31 20:06:05.964649 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 454/903] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:05 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:06:06.253934 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-82afc31a-19cb-4180-9553-81635dddb341 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:06.254665 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-82afc31a-19cb-4180-9553-81635dddb341 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:06.261343 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82afc31a-19cb-4180-9553-81635dddb341 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:06.261788 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82afc31a-19cb-4180-9553-81635dddb341 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:06.262560 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82afc31a-19cb-4180-9553-81635dddb341 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:06.262989 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82afc31a-19cb-4180-9553-81635dddb341 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:06.397775 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-82afc31a-19cb-4180-9553-81635dddb341 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:06.405868 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-82afc31a-19cb-4180-9553-81635dddb341 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.156939 Jul 31 20:06:06.406433 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 450/904] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:06 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:06.769199 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6a9b7d39-bdca-4ffd-b1e5-b9f5f7ceb216 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:06.771571 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6a9b7d39-bdca-4ffd-b1e5-b9f5f7ceb216 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:06.773908 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=68 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:06:06.779969 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a9b7d39-bdca-4ffd-b1e5-b9f5f7ceb216 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:06.780408 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a9b7d39-bdca-4ffd-b1e5-b9f5f7ceb216 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:06.781198 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a9b7d39-bdca-4ffd-b1e5-b9f5f7ceb216 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:06.781617 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a9b7d39-bdca-4ffd-b1e5-b9f5f7ceb216 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:06.812760 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6a9b7d39-bdca-4ffd-b1e5-b9f5f7ceb216 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047889 Jul 31 20:06:06.813353 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 455/905] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:06:06 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:06.991456 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-afbd5177-9986-475e-babc-df283ebb4d06 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:06.992363 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-afbd5177-9986-475e-babc-df283ebb4d06 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:07.002879 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-afbd5177-9986-475e-babc-df283ebb4d06 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:07.003336 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-afbd5177-9986-475e-babc-df283ebb4d06 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:07.004099 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-afbd5177-9986-475e-babc-df283ebb4d06 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:07.004533 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-afbd5177-9986-475e-babc-df283ebb4d06 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:07.138698 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-afbd5177-9986-475e-babc-df283ebb4d06 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:07.147404 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-afbd5177-9986-475e-babc-df283ebb4d06 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:07.148894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-afbd5177-9986-475e-babc-df283ebb4d06 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:07.150072 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-afbd5177-9986-475e-babc-df283ebb4d06 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1722 microversion: 2.20 time: 0.165480 Jul 31 20:06:07.150700 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 451/906] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:06 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:07.429861 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f23e9bb1-c4b8-41aa-bc21-105378befa69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:07.430595 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f23e9bb1-c4b8-41aa-bc21-105378befa69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:07.436978 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f23e9bb1-c4b8-41aa-bc21-105378befa69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:07.437464 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f23e9bb1-c4b8-41aa-bc21-105378befa69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:07.438237 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f23e9bb1-c4b8-41aa-bc21-105378befa69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:07.438731 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f23e9bb1-c4b8-41aa-bc21-105378befa69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:07.574452 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f23e9bb1-c4b8-41aa-bc21-105378befa69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:07.582772 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f23e9bb1-c4b8-41aa-bc21-105378befa69 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.158763 Jul 31 20:06:07.583272 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 456/907] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:07 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:07.825669 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bc3b264c-9f19-41fb-b7d3-bdd4f9dccbba tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:07.827803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bc3b264c-9f19-41fb-b7d3-bdd4f9dccbba tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:07.834290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc3b264c-9f19-41fb-b7d3-bdd4f9dccbba tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:07.835381 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc3b264c-9f19-41fb-b7d3-bdd4f9dccbba tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:07.836170 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc3b264c-9f19-41fb-b7d3-bdd4f9dccbba tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:07.836749 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc3b264c-9f19-41fb-b7d3-bdd4f9dccbba tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:07.865959 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bc3b264c-9f19-41fb-b7d3-bdd4f9dccbba tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044518 Jul 31 20:06:07.866500 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 452/908] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:06:07 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 20:06:07.983692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fc2e5770-8a2b-4b03-be41-c4b9625ebe76 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:07.986743 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fc2e5770-8a2b-4b03-be41-c4b9625ebe76 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:07.995015 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc2e5770-8a2b-4b03-be41-c4b9625ebe76 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:07.995822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc2e5770-8a2b-4b03-be41-c4b9625ebe76 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:07.996687 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc2e5770-8a2b-4b03-be41-c4b9625ebe76 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:07.997171 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc2e5770-8a2b-4b03-be41-c4b9625ebe76 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:08.028259 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fc2e5770-8a2b-4b03-be41-c4b9625ebe76 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049280 Jul 31 20:06:08.029010 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 457/909] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:06:07 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 20:06:08.093886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-91d3e6ab-1ad2-479c-aef7-ad8d4db21d33 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:08.094421 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-91d3e6ab-1ad2-479c-aef7-ad8d4db21d33 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:08.101037 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-91d3e6ab-1ad2-479c-aef7-ad8d4db21d33 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:08.101540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-91d3e6ab-1ad2-479c-aef7-ad8d4db21d33 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:08.102306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-91d3e6ab-1ad2-479c-aef7-ad8d4db21d33 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:08.102741 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-91d3e6ab-1ad2-479c-aef7-ad8d4db21d33 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:08.129270 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-91d3e6ab-1ad2-479c-aef7-ad8d4db21d33 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:06:08.173436 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a2aba1ff-ce07-487b-a802-f7f1e1a560f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:08.174219 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a2aba1ff-ce07-487b-a802-f7f1e1a560f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:08.181090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2aba1ff-ce07-487b-a802-f7f1e1a560f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:08.181650 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2aba1ff-ce07-487b-a802-f7f1e1a560f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:08.182492 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2aba1ff-ce07-487b-a802-f7f1e1a560f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:08.183027 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2aba1ff-ce07-487b-a802-f7f1e1a560f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:08.210084 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-91d3e6ab-1ad2-479c-aef7-ad8d4db21d33 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 204 len: 0 microversion: 2.1 time: 0.120287 Jul 31 20:06:08.210892 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 453/910] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:06:08 2022] DELETE /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:06:08.219699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cbb7b3d2-e6b8-40e9-a579-dc104cd350c9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:08.220413 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cbb7b3d2-e6b8-40e9-a579-dc104cd350c9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:08.227331 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbb7b3d2-e6b8-40e9-a579-dc104cd350c9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:08.228308 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbb7b3d2-e6b8-40e9-a579-dc104cd350c9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:08.229254 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbb7b3d2-e6b8-40e9-a579-dc104cd350c9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:08.229695 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbb7b3d2-e6b8-40e9-a579-dc104cd350c9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:08.365940 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a2aba1ff-ce07-487b-a802-f7f1e1a560f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:08.374325 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a2aba1ff-ce07-487b-a802-f7f1e1a560f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:08.375805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a2aba1ff-ce07-487b-a802-f7f1e1a560f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:08.377061 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a2aba1ff-ce07-487b-a802-f7f1e1a560f1 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1665 microversion: 2.20 time: 0.207681 Jul 31 20:06:08.377857 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 458/911] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:08 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1665 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:08.396327 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cbb7b3d2-e6b8-40e9-a579-dc104cd350c9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:08.398804 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6d42ba8f-bbb5-48c9-b411-c1ea80079a63 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44a0a790-2d01-49d8-8dad-ca93aedb15ee"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:06:08.401109 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6d42ba8f-bbb5-48c9-b411-c1ea80079a63 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:08.404358 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cbb7b3d2-e6b8-40e9-a579-dc104cd350c9 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1676 microversion: 2.1 time: 0.188906 Jul 31 20:06:08.404928 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 454/912] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:08 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:08.407182 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d42ba8f-bbb5-48c9-b411-c1ea80079a63 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:08.407614 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d42ba8f-bbb5-48c9-b411-c1ea80079a63 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:08.408429 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d42ba8f-bbb5-48c9-b411-c1ea80079a63 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:08.408853 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d42ba8f-bbb5-48c9-b411-c1ea80079a63 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:08.604805 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-96b31c27-8516-4e76-9d65-61359f1d7a68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:08.605536 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-96b31c27-8516-4e76-9d65-61359f1d7a68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:08.612115 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96b31c27-8516-4e76-9d65-61359f1d7a68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:08.612660 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96b31c27-8516-4e76-9d65-61359f1d7a68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:08.615891 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96b31c27-8516-4e76-9d65-61359f1d7a68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:08.615891 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96b31c27-8516-4e76-9d65-61359f1d7a68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:08.708095 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6d42ba8f-bbb5-48c9-b411-c1ea80079a63 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "POST /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313038 Jul 31 20:06:08.708711 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 459/913] 10.222.0.48 () {62 vars in 1364 bytes} [Sun Jul 31 20:06:08 2022] POST /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/os-volume_attachments => generated 188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 20:06:08.757425 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-96b31c27-8516-4e76-9d65-61359f1d7a68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:08.765188 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-96b31c27-8516-4e76-9d65-61359f1d7a68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.164632 Jul 31 20:06:08.765784 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 455/914] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:08 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:08.831296 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a6f8ed3-ec47-41b4-8f7e-2e4f40eb3793 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:08.832077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a6f8ed3-ec47-41b4-8f7e-2e4f40eb3793 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:08.838462 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a6f8ed3-ec47-41b4-8f7e-2e4f40eb3793 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:08.838903 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a6f8ed3-ec47-41b4-8f7e-2e4f40eb3793 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:08.839665 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a6f8ed3-ec47-41b4-8f7e-2e4f40eb3793 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:08.840142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a6f8ed3-ec47-41b4-8f7e-2e4f40eb3793 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:09.086239 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a6f8ed3-ec47-41b4-8f7e-2e4f40eb3793 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "DELETE /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/os-volume_attachments/44a0a790-2d01-49d8-8dad-ca93aedb15ee" status: 202 len: 0 microversion: 2.20 time: 0.259312 Jul 31 20:06:09.086884 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 460/915] 10.222.0.48 () {60 vars in 1457 bytes} [Sun Jul 31 20:06:08 2022] DELETE /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/os-volume_attachments/44a0a790-2d01-49d8-8dad-ca93aedb15ee => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:06:09.146795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5a67cca8-a65c-4a6c-85fb-413a5d868c4d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:06:09.147392 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5a67cca8-a65c-4a6c-85fb-413a5d868c4d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:09.153912 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a67cca8-a65c-4a6c-85fb-413a5d868c4d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:09.154356 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a67cca8-a65c-4a6c-85fb-413a5d868c4d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:09.155123 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a67cca8-a65c-4a6c-85fb-413a5d868c4d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:09.155553 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a67cca8-a65c-4a6c-85fb-413a5d868c4d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:09.186899 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5a67cca8-a65c-4a6c-85fb-413a5d868c4d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117919) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 20:06:09.210997 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:06:09.258636 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5a67cca8-a65c-4a6c-85fb-413a5d868c4d tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "POST /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/action" status: 202 len: 0 microversion: 2.20 time: 0.115753 Jul 31 20:06:09.259357 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 456/916] 10.222.0.48 () {62 vars in 1319 bytes} [Sun Jul 31 20:06:09 2022] POST /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:06:09.267519 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fadec103-ee67-4afd-894a-06fc3d574214 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:09.268207 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fadec103-ee67-4afd-894a-06fc3d574214 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:09.274728 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fadec103-ee67-4afd-894a-06fc3d574214 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:09.275132 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fadec103-ee67-4afd-894a-06fc3d574214 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:09.275928 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fadec103-ee67-4afd-894a-06fc3d574214 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:09.276427 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fadec103-ee67-4afd-894a-06fc3d574214 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:09.426805 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5026ec9d-cf64-45da-9fee-b332421e02ad tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:09.427399 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5026ec9d-cf64-45da-9fee-b332421e02ad tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:09.434280 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5026ec9d-cf64-45da-9fee-b332421e02ad tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:09.434778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5026ec9d-cf64-45da-9fee-b332421e02ad tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:09.435833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5026ec9d-cf64-45da-9fee-b332421e02ad tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:09.436274 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5026ec9d-cf64-45da-9fee-b332421e02ad tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:09.461054 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fadec103-ee67-4afd-894a-06fc3d574214 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:09.474219 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fadec103-ee67-4afd-894a-06fc3d574214 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:09.475806 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fadec103-ee67-4afd-894a-06fc3d574214 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:09.477039 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fadec103-ee67-4afd-894a-06fc3d574214 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1673 microversion: 2.20 time: 0.213417 Jul 31 20:06:09.477859 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 461/917] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:09 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1673 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:09.581590 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-88c9c52a-80db-4f44-aa06-877e6e9eb494 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:09.582169 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-88c9c52a-80db-4f44-aa06-877e6e9eb494 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:09.592313 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88c9c52a-80db-4f44-aa06-877e6e9eb494 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:09.592753 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88c9c52a-80db-4f44-aa06-877e6e9eb494 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:09.597333 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88c9c52a-80db-4f44-aa06-877e6e9eb494 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:09.597785 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88c9c52a-80db-4f44-aa06-877e6e9eb494 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:09.644156 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-88c9c52a-80db-4f44-aa06-877e6e9eb494 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/ips" status: 200 len: 149 microversion: 2.1 time: 0.067219 Jul 31 20:06:09.644750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 462/918] 10.222.0.48 () {58 vars in 1248 bytes} [Sun Jul 31 20:06:09 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/ips => generated 149 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:09.649816 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5026ec9d-cf64-45da-9fee-b332421e02ad tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:09.658168 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5026ec9d-cf64-45da-9fee-b332421e02ad tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1676 microversion: 2.1 time: 0.236929 Jul 31 20:06:09.660066 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 457/919] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:09 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:06:09.787082 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e3ee9763-59bf-4879-b6e1-f99004cf9bd2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:09.788022 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3ee9763-59bf-4879-b6e1-f99004cf9bd2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:09.796483 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3ee9763-59bf-4879-b6e1-f99004cf9bd2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:09.796918 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3ee9763-59bf-4879-b6e1-f99004cf9bd2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:09.802772 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3ee9763-59bf-4879-b6e1-f99004cf9bd2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:09.808743 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3ee9763-59bf-4879-b6e1-f99004cf9bd2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:09.991422 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3ee9763-59bf-4879-b6e1-f99004cf9bd2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:10.003958 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e3ee9763-59bf-4879-b6e1-f99004cf9bd2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.220812 Jul 31 20:06:10.004884 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 463/920] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:09 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:10.503761 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-408805b8-6579-4a68-afcd-c1cddb1b0f17 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:10.505399 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-408805b8-6579-4a68-afcd-c1cddb1b0f17 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:10.523109 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-408805b8-6579-4a68-afcd-c1cddb1b0f17 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:10.525204 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-408805b8-6579-4a68-afcd-c1cddb1b0f17 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:10.527654 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-408805b8-6579-4a68-afcd-c1cddb1b0f17 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:10.530404 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-408805b8-6579-4a68-afcd-c1cddb1b0f17 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:10.683875 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3cb38c1c-84e8-4d88-8162-4252b94c1b83 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:10.684591 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3cb38c1c-84e8-4d88-8162-4252b94c1b83 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:10.694237 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cb38c1c-84e8-4d88-8162-4252b94c1b83 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:10.694768 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cb38c1c-84e8-4d88-8162-4252b94c1b83 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:10.695632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cb38c1c-84e8-4d88-8162-4252b94c1b83 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:10.696299 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cb38c1c-84e8-4d88-8162-4252b94c1b83 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:10.862822 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-408805b8-6579-4a68-afcd-c1cddb1b0f17 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:10.875397 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-408805b8-6579-4a68-afcd-c1cddb1b0f17 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:10.877288 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-408805b8-6579-4a68-afcd-c1cddb1b0f17 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:10.878752 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-408805b8-6579-4a68-afcd-c1cddb1b0f17 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1673 microversion: 2.20 time: 0.381116 Jul 31 20:06:10.879252 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 458/921] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:10 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1673 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:10.985884 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3cb38c1c-84e8-4d88-8162-4252b94c1b83 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:10.994536 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3cb38c1c-84e8-4d88-8162-4252b94c1b83 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1676 microversion: 2.1 time: 0.316190 Jul 31 20:06:11.009135 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 464/922] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:10 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1676 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:11.026580 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-224a0e17-518a-4e98-a36b-d713b085e56b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:11.027376 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-224a0e17-518a-4e98-a36b-d713b085e56b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:11.038587 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-224a0e17-518a-4e98-a36b-d713b085e56b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:11.039068 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-224a0e17-518a-4e98-a36b-d713b085e56b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:11.040060 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-224a0e17-518a-4e98-a36b-d713b085e56b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:11.040520 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-224a0e17-518a-4e98-a36b-d713b085e56b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:11.123840 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2ab40635-190f-4f82-b124-a343cf759d07 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "866f5fc7-6d4b-43e3-a83c-be722a861694"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:06:11.127599 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2ab40635-190f-4f82-b124-a343cf759d07 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:11.144155 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ab40635-190f-4f82-b124-a343cf759d07 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:11.144605 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ab40635-190f-4f82-b124-a343cf759d07 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:11.145422 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ab40635-190f-4f82-b124-a343cf759d07 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:11.145854 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ab40635-190f-4f82-b124-a343cf759d07 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:11.261064 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:06:11.291778 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-224a0e17-518a-4e98-a36b-d713b085e56b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:11.305545 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-224a0e17-518a-4e98-a36b-d713b085e56b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.283017 Jul 31 20:06:11.307039 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 459/923] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:11 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:11.528570 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2ab40635-190f-4f82-b124-a343cf759d07 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "POST /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414980 Jul 31 20:06:11.529214 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 465/924] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:06:11 2022] POST /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:06:11.683094 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-052bf780-c841-4d74-a605-12076c51fbb0 req-63949a99-4d18-4ffa-b126-66efa1b6646f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c471e2c-987e-4ad0-add6-c22b5ca1ec73", "name": "network-vif-deleted", "tag": "7413dd38-41ac-44d9-ac58-22d2506ad9ce"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:06:11.705473 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-052bf780-c841-4d74-a605-12076c51fbb0 req-63949a99-4d18-4ffa-b126-66efa1b6646f service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:11.713730 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-052bf780-c841-4d74-a605-12076c51fbb0 req-63949a99-4d18-4ffa-b126-66efa1b6646f service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:11.757739 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-052bf780-c841-4d74-a605-12076c51fbb0 req-63949a99-4d18-4ffa-b126-66efa1b6646f service nova] Creating event network-vif-deleted:7413dd38-41ac-44d9-ac58-22d2506ad9ce for instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 on hv-cinder-84984 Jul 31 20:06:11.770499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-052bf780-c841-4d74-a605-12076c51fbb0 req-63949a99-4d18-4ffa-b126-66efa1b6646f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092186 Jul 31 20:06:11.771659 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 460/925] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:11.904956 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1738eb5a-e0bb-4dc4-a787-9697f7f0ad42 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:11.905683 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1738eb5a-e0bb-4dc4-a787-9697f7f0ad42 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:11.914750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1738eb5a-e0bb-4dc4-a787-9697f7f0ad42 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:11.915187 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1738eb5a-e0bb-4dc4-a787-9697f7f0ad42 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:11.922678 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1738eb5a-e0bb-4dc4-a787-9697f7f0ad42 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:11.924991 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1738eb5a-e0bb-4dc4-a787-9697f7f0ad42 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:12.022645 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b5897bd-6aa5-4a98-bac3-57b39cf3ddab tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:12.023811 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7b5897bd-6aa5-4a98-bac3-57b39cf3ddab tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:12.035645 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5897bd-6aa5-4a98-bac3-57b39cf3ddab tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:12.036480 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5897bd-6aa5-4a98-bac3-57b39cf3ddab tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:12.037760 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5897bd-6aa5-4a98-bac3-57b39cf3ddab tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:12.038357 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5897bd-6aa5-4a98-bac3-57b39cf3ddab tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:12.079197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5897bd-6aa5-4a98-bac3-57b39cf3ddab tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:12.079797 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5897bd-6aa5-4a98-bac3-57b39cf3ddab tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:12.080409 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-7b5897bd-6aa5-4a98-bac3-57b39cf3ddab tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lazy-loading 'fault' on Instance uuid 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:06:12.142131 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7b5897bd-6aa5-4a98-bac3-57b39cf3ddab tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83717eeddd7347209a660ce46877d41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb02d5d721347988f4eaff1bb027dcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:12.158651 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7b5897bd-6aa5-4a98-bac3-57b39cf3ddab tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 200 len: 1328 microversion: 2.1 time: 0.145927 Jul 31 20:06:12.159786 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 461/926] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:12 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 1328 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:06:12.163802 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1738eb5a-e0bb-4dc4-a787-9697f7f0ad42 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:12.172825 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1738eb5a-e0bb-4dc4-a787-9697f7f0ad42 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:12.174519 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1738eb5a-e0bb-4dc4-a787-9697f7f0ad42 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:12.175702 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1738eb5a-e0bb-4dc4-a787-9697f7f0ad42 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.277191 Jul 31 20:06:12.176252 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 466/927] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:11 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:12.327641 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-32547881-1112-497e-8290-972ae0d863f2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:12.328574 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-32547881-1112-497e-8290-972ae0d863f2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:12.335012 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32547881-1112-497e-8290-972ae0d863f2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:12.335701 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32547881-1112-497e-8290-972ae0d863f2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:12.336797 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32547881-1112-497e-8290-972ae0d863f2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:12.337493 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32547881-1112-497e-8290-972ae0d863f2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:12.563062 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-32547881-1112-497e-8290-972ae0d863f2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:12.575755 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-32547881-1112-497e-8290-972ae0d863f2 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.251837 Jul 31 20:06:12.576925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 462/928] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:12 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:13.179657 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-76b8d4b2-c3d1-4cbe-b819-1608c14f17db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:13.180360 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-76b8d4b2-c3d1-4cbe-b819-1608c14f17db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:13.187151 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76b8d4b2-c3d1-4cbe-b819-1608c14f17db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:13.187596 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76b8d4b2-c3d1-4cbe-b819-1608c14f17db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:13.188380 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76b8d4b2-c3d1-4cbe-b819-1608c14f17db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:13.188814 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76b8d4b2-c3d1-4cbe-b819-1608c14f17db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:13.200627 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b73f85c-1a67-4d5b-b73a-df2a847c70f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:13.201308 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7b73f85c-1a67-4d5b-b73a-df2a847c70f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:13.203598 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-76b8d4b2-c3d1-4cbe-b819-1608c14f17db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] HTTP exception thrown: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-76b8d4b2-c3d1-4cbe-b819-1608c14f17db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Request method failure captured: Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 HTTP/1.1 Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8sCPcuX64qkgxzlAe-KWSYFEGfDu3jDr7L98bWyTBIdLsI__PF_MFZflc9MBZylcwQPziH62cLMjzLzrEqKtk1521R7gJCpIhFMqWcowc4C9syFYZPR1kOP6OsgTz9rRxMlRoGr79JhEgH3vzKaAEYXkc8UJ7XQm8rG877wndhfTo Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: ebb02d5d721347988f4eaff1bb027dcf Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:06:13.205628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:06:13.207264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ebb02d5d721347988f4eaff1bb027dcf"}]}] Jul 31 20:06:13.207264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:13.207264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ebb02d5d721347988f4eaff1bb027dcf Jul 31 20:06:13.207264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:13.207264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-1202173152-project Jul 31 20:06:13.207264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:06:13.207264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:06:13.207264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 83717eeddd7347209a660ce46877d41d Jul 31 20:06:13.207264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-1202173152-project Jul 31 20:06:13.207264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:06:13.207264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:13.207264 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': '0c471e2c-987e-4ad0-add6-c22b5ca1ec73'} Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:13.208391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:13.210051 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:13.211822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-76b8d4b2-c3d1-4cbe-b819-1608c14f17db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Returning 404 to user: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:13.211822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-76b8d4b2-c3d1-4cbe-b819-1608c14f17db tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 404 len: 111 microversion: 2.1 time: 0.031245 Jul 31 20:06:13.211822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 467/929] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:13 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:13.213099 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b73f85c-1a67-4d5b-b73a-df2a847c70f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:13.213649 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b73f85c-1a67-4d5b-b73a-df2a847c70f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:13.214705 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b73f85c-1a67-4d5b-b73a-df2a847c70f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:13.215302 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b73f85c-1a67-4d5b-b73a-df2a847c70f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:13.215459 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b5a2370-e50f-4be6-a9c9-155e05b97031 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '.version_select at 0x7ffa290b49d0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:13.237761 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b5a2370-e50f-4be6-a9c9-155e05b97031 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240862355" status: 202 len: 0 microversion: 2.1 time: 0.025689 Jul 31 20:06:13.238630 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 468/930] 10.222.0.48 () {58 vars in 1221 bytes} [Sun Jul 31 20:06:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240862355 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:06:13.368424 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7b73f85c-1a67-4d5b-b73a-df2a847c70f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:13.382678 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7b73f85c-1a67-4d5b-b73a-df2a847c70f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:13.385190 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7b73f85c-1a67-4d5b-b73a-df2a847c70f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:13.386635 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7b73f85c-1a67-4d5b-b73a-df2a847c70f0 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.190304 Jul 31 20:06:13.387203 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 463/931] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:13 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:06:13.598736 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-591a3c33-bd7c-403e-ae51-a9bc7aa44152 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:13.599478 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-591a3c33-bd7c-403e-ae51-a9bc7aa44152 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:13.607014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-591a3c33-bd7c-403e-ae51-a9bc7aa44152 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:13.612370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-591a3c33-bd7c-403e-ae51-a9bc7aa44152 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:13.613377 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-591a3c33-bd7c-403e-ae51-a9bc7aa44152 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:13.613902 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-591a3c33-bd7c-403e-ae51-a9bc7aa44152 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:13.923534 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-591a3c33-bd7c-403e-ae51-a9bc7aa44152 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:13.934184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-591a3c33-bd7c-403e-ae51-a9bc7aa44152 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.339344 Jul 31 20:06:13.934924 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 469/932] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:13 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:14.416004 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-90dc3b4e-2172-40fd-a53e-87957d4226bd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:14.416713 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-90dc3b4e-2172-40fd-a53e-87957d4226bd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:14.426810 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90dc3b4e-2172-40fd-a53e-87957d4226bd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:14.427264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90dc3b4e-2172-40fd-a53e-87957d4226bd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:14.428419 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90dc3b4e-2172-40fd-a53e-87957d4226bd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:14.428948 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90dc3b4e-2172-40fd-a53e-87957d4226bd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:14.701552 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-90dc3b4e-2172-40fd-a53e-87957d4226bd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:14.722408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-90dc3b4e-2172-40fd-a53e-87957d4226bd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:14.724921 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-90dc3b4e-2172-40fd-a53e-87957d4226bd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:14.726882 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-90dc3b4e-2172-40fd-a53e-87957d4226bd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.316438 Jul 31 20:06:14.728270 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 464/933] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:14 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:14.955818 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fb023126-4087-464e-9859-a5462ca15b38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:14.967274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fb023126-4087-464e-9859-a5462ca15b38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:14.974733 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb023126-4087-464e-9859-a5462ca15b38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:14.975502 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb023126-4087-464e-9859-a5462ca15b38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:14.976874 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb023126-4087-464e-9859-a5462ca15b38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:14.977544 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb023126-4087-464e-9859-a5462ca15b38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:15.158569 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fb023126-4087-464e-9859-a5462ca15b38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:15.166743 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fb023126-4087-464e-9859-a5462ca15b38 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.214795 Jul 31 20:06:15.167316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 470/934] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:14 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:15.753116 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c4bf3dd6-73d2-4521-992f-694bbebb95c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:15.754460 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c4bf3dd6-73d2-4521-992f-694bbebb95c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:15.761804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4bf3dd6-73d2-4521-992f-694bbebb95c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:15.762674 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4bf3dd6-73d2-4521-992f-694bbebb95c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:15.763816 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4bf3dd6-73d2-4521-992f-694bbebb95c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:15.765474 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4bf3dd6-73d2-4521-992f-694bbebb95c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:15.908407 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-f9731b10-0a3d-4e1d-85d0-5846210c3acc req-1b15df49-5079-4e92-839f-9dbb7cd1927a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9564a93e-d735-4c3b-916b-8e6c325e4b86", "name": "network-vif-plugged", "status": "completed", "tag": "5404fa72-b0c7-496c-a13f-4c664ba48b5c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:06:15.922519 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f9731b10-0a3d-4e1d-85d0-5846210c3acc req-1b15df49-5079-4e92-839f-9dbb7cd1927a service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:15.923122 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f9731b10-0a3d-4e1d-85d0-5846210c3acc req-1b15df49-5079-4e92-839f-9dbb7cd1927a service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:15.940079 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-f9731b10-0a3d-4e1d-85d0-5846210c3acc req-1b15df49-5079-4e92-839f-9dbb7cd1927a service nova] Creating event network-vif-plugged:5404fa72-b0c7-496c-a13f-4c664ba48b5c for instance 9564a93e-d735-4c3b-916b-8e6c325e4b86 on hv-cinder-84984 Jul 31 20:06:15.947265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-f9731b10-0a3d-4e1d-85d0-5846210c3acc req-1b15df49-5079-4e92-839f-9dbb7cd1927a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043046 Jul 31 20:06:15.948693 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 471/935] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:06:15.970282 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c4bf3dd6-73d2-4521-992f-694bbebb95c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:15.979444 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c4bf3dd6-73d2-4521-992f-694bbebb95c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:15.980937 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c4bf3dd6-73d2-4521-992f-694bbebb95c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:15.982311 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c4bf3dd6-73d2-4521-992f-694bbebb95c8 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.234685 Jul 31 20:06:15.982878 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 465/936] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:15 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:16.188606 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4eb7fe71-eda2-4f39-9978-557256f22a55 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:16.190386 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4eb7fe71-eda2-4f39-9978-557256f22a55 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:16.198669 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4eb7fe71-eda2-4f39-9978-557256f22a55 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:16.199548 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4eb7fe71-eda2-4f39-9978-557256f22a55 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:16.200786 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4eb7fe71-eda2-4f39-9978-557256f22a55 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:16.201319 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4eb7fe71-eda2-4f39-9978-557256f22a55 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:16.354500 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4eb7fe71-eda2-4f39-9978-557256f22a55 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:16.364078 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4eb7fe71-eda2-4f39-9978-557256f22a55 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.179685 Jul 31 20:06:16.364658 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 472/937] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:16 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:16.580572 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b4620c40-b37d-455f-b45f-a967d4a6280a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:16.581068 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b4620c40-b37d-455f-b45f-a967d4a6280a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:16.587516 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4620c40-b37d-455f-b45f-a967d4a6280a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:16.587967 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4620c40-b37d-455f-b45f-a967d4a6280a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:16.588740 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4620c40-b37d-455f-b45f-a967d4a6280a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:16.590054 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4620c40-b37d-455f-b45f-a967d4a6280a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:16.608779 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-b4620c40-b37d-455f-b45f-a967d4a6280a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] HTTP exception thrown: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b4620c40-b37d-455f-b45f-a967d4a6280a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Request method failure captured: Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 HTTP/1.1 Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8sCPcuX64qkgxzlAe-KWSYFEGfDu3jDr7L98bWyTBIdLsI__PF_MFZflc9MBZylcwQPziH62cLMjzLzrEqKtk1521R7gJCpIhFMqWcowc4C9syFYZPR1kOP6OsgTz9rRxMlRoGr79JhEgH3vzKaAEYXkc8UJ7XQm8rG877wndhfTo Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: ebb02d5d721347988f4eaff1bb027dcf Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:06:16.611709 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:06:16.613197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ebb02d5d721347988f4eaff1bb027dcf"}]}] Jul 31 20:06:16.613197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:16.613197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: ebb02d5d721347988f4eaff1bb027dcf Jul 31 20:06:16.613197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:16.613197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeTestJSON-1202173152-project Jul 31 20:06:16.613197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:06:16.613197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:06:16.613197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 83717eeddd7347209a660ce46877d41d Jul 31 20:06:16.613197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeTestJSON-1202173152-project Jul 31 20:06:16.613197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:06:16.613197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:16.613197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '0c471e2c-987e-4ad0-add6-c22b5ca1ec73'} Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:16.613990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:16.615599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:16.616754 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b4620c40-b37d-455f-b45f-a967d4a6280a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Returning 404 to user: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:16.616754 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b4620c40-b37d-455f-b45f-a967d4a6280a tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 404 len: 111 microversion: 2.1 time: 0.037055 Jul 31 20:06:16.616754 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 466/938] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:06:16 2022] DELETE /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:16.623482 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1bd26ade-4ec7-4e5d-bc60-fb1a09e4cbe5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:16.624244 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1bd26ade-4ec7-4e5d-bc60-fb1a09e4cbe5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: 0c471e2c-987e-4ad0-add6-c22b5ca1ec73] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:16.630960 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd26ade-4ec7-4e5d-bc60-fb1a09e4cbe5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:16.631899 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd26ade-4ec7-4e5d-bc60-fb1a09e4cbe5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:16.633099 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd26ade-4ec7-4e5d-bc60-fb1a09e4cbe5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:16.633781 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd26ade-4ec7-4e5d-bc60-fb1a09e4cbe5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:16.649089 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-1bd26ade-4ec7-4e5d-bc60-fb1a09e4cbe5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] HTTP exception thrown: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1bd26ade-4ec7-4e5d-bc60-fb1a09e4cbe5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Request method failure captured: Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 HTTP/1.1 Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8sCPcuX64qkgxzlAe-KWSYFEGfDu3jDr7L98bWyTBIdLsI__PF_MFZflc9MBZylcwQPziH62cLMjzLzrEqKtk1521R7gJCpIhFMqWcowc4C9syFYZPR1kOP6OsgTz9rRxMlRoGr79JhEgH3vzKaAEYXkc8UJ7XQm8rG877wndhfTo Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: ebb02d5d721347988f4eaff1bb027dcf Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:06:16.650860 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:06:16.652184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ebb02d5d721347988f4eaff1bb027dcf"}]}] Jul 31 20:06:16.652184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:16.652184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ebb02d5d721347988f4eaff1bb027dcf Jul 31 20:06:16.652184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:16.652184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-1202173152-project Jul 31 20:06:16.652184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:06:16.652184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:06:16.652184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 83717eeddd7347209a660ce46877d41d Jul 31 20:06:16.652184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-1202173152-project Jul 31 20:06:16.652184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:06:16.652184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:16.652184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': '0c471e2c-987e-4ad0-add6-c22b5ca1ec73'} Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:16.652904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. Jul 31 20:06:16.655106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:16.656374 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1bd26ade-4ec7-4e5d-bc60-fb1a09e4cbe5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Returning 404 to user: Instance 0c471e2c-987e-4ad0-add6-c22b5ca1ec73 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:16.656374 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1bd26ade-4ec7-4e5d-bc60-fb1a09e4cbe5 tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73" status: 404 len: 111 microversion: 2.1 time: 0.033684 Jul 31 20:06:16.656374 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 473/939] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:16 2022] GET /compute/v2.1/servers/0c471e2c-987e-4ad0-add6-c22b5ca1ec73 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:17.008884 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a9cb463d-e473-4b88-bb0b-f5f2c291f396 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:17.009886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a9cb463d-e473-4b88-bb0b-f5f2c291f396 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:17.018143 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a9cb463d-e473-4b88-bb0b-f5f2c291f396 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:17.018909 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a9cb463d-e473-4b88-bb0b-f5f2c291f396 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:17.019890 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a9cb463d-e473-4b88-bb0b-f5f2c291f396 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:17.020509 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a9cb463d-e473-4b88-bb0b-f5f2c291f396 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:17.271244 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a9cb463d-e473-4b88-bb0b-f5f2c291f396 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:17.279620 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a9cb463d-e473-4b88-bb0b-f5f2c291f396 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:17.281109 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a9cb463d-e473-4b88-bb0b-f5f2c291f396 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:17.282379 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a9cb463d-e473-4b88-bb0b-f5f2c291f396 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.277948 Jul 31 20:06:17.282937 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 467/940] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:17 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:17.387020 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8dd5e234-61bc-4881-978e-591497ff9f68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:17.388277 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8dd5e234-61bc-4881-978e-591497ff9f68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:17.397814 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd5e234-61bc-4881-978e-591497ff9f68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:17.398265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd5e234-61bc-4881-978e-591497ff9f68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:17.399041 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd5e234-61bc-4881-978e-591497ff9f68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:17.399463 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd5e234-61bc-4881-978e-591497ff9f68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:17.571418 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8dd5e234-61bc-4881-978e-591497ff9f68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:17.581237 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8dd5e234-61bc-4881-978e-591497ff9f68 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.198251 Jul 31 20:06:17.582075 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 474/941] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:17 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:17.861530 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-746f0cc7-cd42-4a04-a320-66397be03aeb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:17.862027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-746f0cc7-cd42-4a04-a320-66397be03aeb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:17.868973 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-746f0cc7-cd42-4a04-a320-66397be03aeb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:17.869717 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-746f0cc7-cd42-4a04-a320-66397be03aeb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:17.870968 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-746f0cc7-cd42-4a04-a320-66397be03aeb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:17.871529 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-746f0cc7-cd42-4a04-a320-66397be03aeb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:17.888635 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-746f0cc7-cd42-4a04-a320-66397be03aeb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] HTTP exception thrown: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-746f0cc7-cd42-4a04-a320-66397be03aeb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Request method failure captured: Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 HTTP/1.1 Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8sCPcuX64qkgxzlAe-KWSYFEGfDu3jDr7L98bWyTBIdLsI__PF_MFZflc9MBZylcwQPziH62cLMjzLzrEqKtk1521R7gJCpIhFMqWcowc4C9syFYZPR1kOP6OsgTz9rRxMlRoGr79JhEgH3vzKaAEYXkc8UJ7XQm8rG877wndhfTo Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: ebb02d5d721347988f4eaff1bb027dcf Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:06:17.891141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:06:17.892799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ebb02d5d721347988f4eaff1bb027dcf"}]}] Jul 31 20:06:17.892799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:17.892799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: ebb02d5d721347988f4eaff1bb027dcf Jul 31 20:06:17.892799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:17.892799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeTestJSON-1202173152-project Jul 31 20:06:17.892799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:06:17.892799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:06:17.892799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 83717eeddd7347209a660ce46877d41d Jul 31 20:06:17.892799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeTestJSON-1202173152-project Jul 31 20:06:17.892799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:06:17.892799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:06:17.892799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': 'bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485'} Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:17.894089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:06:17.896103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:17.897632 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-746f0cc7-cd42-4a04-a320-66397be03aeb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Returning 404 to user: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:17.898271 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-746f0cc7-cd42-4a04-a320-66397be03aeb tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 404 len: 111 microversion: 2.1 time: 0.041421 Jul 31 20:06:17.899263 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 468/942] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:06:17 2022] DELETE /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:17.908552 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ca386a3b-26a6-465b-adbc-9d807dd2137e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:17.908552 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ca386a3b-26a6-465b-adbc-9d807dd2137e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] [instance: bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:17.917043 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca386a3b-26a6-465b-adbc-9d807dd2137e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:17.920902 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca386a3b-26a6-465b-adbc-9d807dd2137e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:17.922127 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca386a3b-26a6-465b-adbc-9d807dd2137e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:17.922681 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca386a3b-26a6-465b-adbc-9d807dd2137e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:18.144118 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-ca386a3b-26a6-465b-adbc-9d807dd2137e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] HTTP exception thrown: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ca386a3b-26a6-465b-adbc-9d807dd2137e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Request method failure captured: Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 HTTP/1.1 Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8sCPcuX64qkgxzlAe-KWSYFEGfDu3jDr7L98bWyTBIdLsI__PF_MFZflc9MBZylcwQPziH62cLMjzLzrEqKtk1521R7gJCpIhFMqWcowc4C9syFYZPR1kOP6OsgTz9rRxMlRoGr79JhEgH3vzKaAEYXkc8UJ7XQm8rG877wndhfTo Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: ebb02d5d721347988f4eaff1bb027dcf Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:06:18.146968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:06:18.148554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ebb02d5d721347988f4eaff1bb027dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ebb02d5d721347988f4eaff1bb027dcf"}]}] Jul 31 20:06:18.148554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:18.148554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ebb02d5d721347988f4eaff1bb027dcf Jul 31 20:06:18.148554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1202173152 Jul 31 20:06:18.148554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-1202173152-project Jul 31 20:06:18.148554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:06:18.148554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:06:18.148554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 83717eeddd7347209a660ce46877d41d Jul 31 20:06:18.148554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-1202173152-project Jul 31 20:06:18.148554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:06:18.148554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:06:18.148554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': 'bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485'} Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:18.149505 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. Jul 31 20:06:18.151307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:18.153416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ca386a3b-26a6-465b-adbc-9d807dd2137e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] Returning 404 to user: Instance bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:18.153416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ca386a3b-26a6-465b-adbc-9d807dd2137e tempest-AttachVolumeTestJSON-1202173152 tempest-AttachVolumeTestJSON-1202173152-project] 10.222.0.48 "GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485" status: 404 len: 111 microversion: 2.1 time: 0.245641 Jul 31 20:06:18.153821 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 475/943] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:17 2022] GET /compute/v2.1/servers/bd0b7644-bb5b-4d8c-8bd7-d26d59c6d485 => generated 111 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:18.308926 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-663b4357-8a9f-46af-975e-3b9ab31fef70 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:18.309723 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-663b4357-8a9f-46af-975e-3b9ab31fef70 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:18.324244 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-663b4357-8a9f-46af-975e-3b9ab31fef70 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:18.331540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-663b4357-8a9f-46af-975e-3b9ab31fef70 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:18.332901 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-663b4357-8a9f-46af-975e-3b9ab31fef70 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:18.333687 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-663b4357-8a9f-46af-975e-3b9ab31fef70 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:18.602950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ec480701-73de-4679-87df-c945ba299eab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:18.604339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ec480701-73de-4679-87df-c945ba299eab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:18.623371 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec480701-73de-4679-87df-c945ba299eab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:18.633304 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec480701-73de-4679-87df-c945ba299eab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:18.637210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec480701-73de-4679-87df-c945ba299eab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:18.637933 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec480701-73de-4679-87df-c945ba299eab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:18.642219 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-663b4357-8a9f-46af-975e-3b9ab31fef70 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:18.652444 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-663b4357-8a9f-46af-975e-3b9ab31fef70 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:18.654073 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-663b4357-8a9f-46af-975e-3b9ab31fef70 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:18.655476 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-663b4357-8a9f-46af-975e-3b9ab31fef70 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.353410 Jul 31 20:06:18.656686 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 469/944] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:18 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:18.916162 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ec480701-73de-4679-87df-c945ba299eab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:18.925746 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ec480701-73de-4679-87df-c945ba299eab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.326728 Jul 31 20:06:18.926919 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 476/945] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:18 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:06:19.683260 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bfeca230-03c0-4a5f-8db0-b873ec467f03 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:19.683810 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bfeca230-03c0-4a5f-8db0-b873ec467f03 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:19.690961 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfeca230-03c0-4a5f-8db0-b873ec467f03 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:19.691408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfeca230-03c0-4a5f-8db0-b873ec467f03 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:19.692183 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfeca230-03c0-4a5f-8db0-b873ec467f03 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:19.692617 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfeca230-03c0-4a5f-8db0-b873ec467f03 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:19.948303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-789bb9de-ea6d-4a91-8c76-c2b75766a16c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:19.949579 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-789bb9de-ea6d-4a91-8c76-c2b75766a16c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:19.962119 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-789bb9de-ea6d-4a91-8c76-c2b75766a16c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:19.962749 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-789bb9de-ea6d-4a91-8c76-c2b75766a16c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:19.963631 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-789bb9de-ea6d-4a91-8c76-c2b75766a16c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:19.964169 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-789bb9de-ea6d-4a91-8c76-c2b75766a16c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:20.189029 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bfeca230-03c0-4a5f-8db0-b873ec467f03 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:20.197577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bfeca230-03c0-4a5f-8db0-b873ec467f03 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:20.199280 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bfeca230-03c0-4a5f-8db0-b873ec467f03 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:20.200276 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bfeca230-03c0-4a5f-8db0-b873ec467f03 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.521155 Jul 31 20:06:20.210372 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 470/946] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:19 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:20.364380 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-789bb9de-ea6d-4a91-8c76-c2b75766a16c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:20.376494 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-789bb9de-ea6d-4a91-8c76-c2b75766a16c tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.432335 Jul 31 20:06:20.377827 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 477/947] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:19 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:21.224390 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fcf4201a-8230-4a1c-b9f3-63041bdc897a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:21.225269 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fcf4201a-8230-4a1c-b9f3-63041bdc897a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:21.232906 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcf4201a-8230-4a1c-b9f3-63041bdc897a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:21.233599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcf4201a-8230-4a1c-b9f3-63041bdc897a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:21.234229 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcf4201a-8230-4a1c-b9f3-63041bdc897a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:21.234824 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcf4201a-8230-4a1c-b9f3-63041bdc897a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:21.399118 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1276b4ac-06b0-4be5-913e-93cec6096d22 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:21.400284 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1276b4ac-06b0-4be5-913e-93cec6096d22 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:21.416786 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1276b4ac-06b0-4be5-913e-93cec6096d22 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:21.417653 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1276b4ac-06b0-4be5-913e-93cec6096d22 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:21.418704 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1276b4ac-06b0-4be5-913e-93cec6096d22 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:21.419292 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1276b4ac-06b0-4be5-913e-93cec6096d22 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:21.488418 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fcf4201a-8230-4a1c-b9f3-63041bdc897a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:21.501688 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fcf4201a-8230-4a1c-b9f3-63041bdc897a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:21.506751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fcf4201a-8230-4a1c-b9f3-63041bdc897a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:21.511921 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fcf4201a-8230-4a1c-b9f3-63041bdc897a tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.291409 Jul 31 20:06:21.513407 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 471/948] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:21 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:21.720982 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1276b4ac-06b0-4be5-913e-93cec6096d22 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:21.742093 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1276b4ac-06b0-4be5-913e-93cec6096d22 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.346951 Jul 31 20:06:21.748357 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 478/949] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:21 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:22.536077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d47a1360-ef80-4fe8-bba2-dac02ef27372 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:22.536678 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d47a1360-ef80-4fe8-bba2-dac02ef27372 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:22.542970 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d47a1360-ef80-4fe8-bba2-dac02ef27372 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:22.543806 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d47a1360-ef80-4fe8-bba2-dac02ef27372 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:22.544167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d47a1360-ef80-4fe8-bba2-dac02ef27372 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:22.544594 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d47a1360-ef80-4fe8-bba2-dac02ef27372 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:22.739983 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d47a1360-ef80-4fe8-bba2-dac02ef27372 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:22.750728 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d47a1360-ef80-4fe8-bba2-dac02ef27372 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:22.752881 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d47a1360-ef80-4fe8-bba2-dac02ef27372 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:22.754577 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d47a1360-ef80-4fe8-bba2-dac02ef27372 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.222442 Jul 31 20:06:22.755644 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 472/950] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:22 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:22.763078 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-29b41973-c6eb-4443-b8ca-8a3c4657c745 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:22.764303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-29b41973-c6eb-4443-b8ca-8a3c4657c745 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:22.772217 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29b41973-c6eb-4443-b8ca-8a3c4657c745 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:22.772861 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29b41973-c6eb-4443-b8ca-8a3c4657c745 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:22.773972 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29b41973-c6eb-4443-b8ca-8a3c4657c745 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:22.779464 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29b41973-c6eb-4443-b8ca-8a3c4657c745 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:23.071070 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-29b41973-c6eb-4443-b8ca-8a3c4657c745 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:23.079387 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-29b41973-c6eb-4443-b8ca-8a3c4657c745 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.320086 Jul 31 20:06:23.093054 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 479/951] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:22 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:23.781256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6ecfa294-c3bb-484c-bc0c-1e14444c0ee6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:23.781990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6ecfa294-c3bb-484c-bc0c-1e14444c0ee6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:23.795163 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ecfa294-c3bb-484c-bc0c-1e14444c0ee6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:23.795821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ecfa294-c3bb-484c-bc0c-1e14444c0ee6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:23.797020 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ecfa294-c3bb-484c-bc0c-1e14444c0ee6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:23.799206 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6ecfa294-c3bb-484c-bc0c-1e14444c0ee6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:23.993068 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6ecfa294-c3bb-484c-bc0c-1e14444c0ee6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:24.003141 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6ecfa294-c3bb-484c-bc0c-1e14444c0ee6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:24.004772 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6ecfa294-c3bb-484c-bc0c-1e14444c0ee6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:24.017222 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6ecfa294-c3bb-484c-bc0c-1e14444c0ee6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.229142 Jul 31 20:06:24.019998 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b42f2435-8020-47ff-9726-821621ea263f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:24.020763 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b42f2435-8020-47ff-9726-821621ea263f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:24.027756 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b42f2435-8020-47ff-9726-821621ea263f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:24.028421 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b42f2435-8020-47ff-9726-821621ea263f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:24.029409 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b42f2435-8020-47ff-9726-821621ea263f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:24.029991 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b42f2435-8020-47ff-9726-821621ea263f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:24.032005 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 473/952] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:23 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:24.101698 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-69f93478-91f2-4bbe-8fb9-ad1f6fb01cab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:24.102595 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-69f93478-91f2-4bbe-8fb9-ad1f6fb01cab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:24.109375 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69f93478-91f2-4bbe-8fb9-ad1f6fb01cab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:24.109890 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69f93478-91f2-4bbe-8fb9-ad1f6fb01cab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:24.110876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69f93478-91f2-4bbe-8fb9-ad1f6fb01cab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:24.111649 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69f93478-91f2-4bbe-8fb9-ad1f6fb01cab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:24.117543 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:06:24.126393 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-b42f2435-8020-47ff-9726-821621ea263f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lazy-loading 'services' on Instance uuid 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:06:24.213958 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b42f2435-8020-47ff-9726-821621ea263f tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/os-volume_attachments/866f5fc7-6d4b-43e3-a83c-be722a861694" status: 202 len: 0 microversion: 2.1 time: 0.197681 Jul 31 20:06:24.214527 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 480/953] 10.222.0.48 () {58 vars in 1416 bytes} [Sun Jul 31 20:06:24 2022] DELETE /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/os-volume_attachments/866f5fc7-6d4b-43e3-a83c-be722a861694 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:06:24.223117 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b1c9063f-b457-45a4-973f-6e2cf9d7231c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:24.225353 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b1c9063f-b457-45a4-973f-6e2cf9d7231c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:24.231845 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1c9063f-b457-45a4-973f-6e2cf9d7231c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:24.232224 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1c9063f-b457-45a4-973f-6e2cf9d7231c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:24.232998 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1c9063f-b457-45a4-973f-6e2cf9d7231c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:24.233458 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1c9063f-b457-45a4-973f-6e2cf9d7231c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:24.272413 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b1c9063f-b457-45a4-973f-6e2cf9d7231c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053417 Jul 31 20:06:24.272988 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 481/954] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:06:24 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:06:24.282447 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-69f93478-91f2-4bbe-8fb9-ad1f6fb01cab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:24.291427 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-69f93478-91f2-4bbe-8fb9-ad1f6fb01cab tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1573 microversion: 2.1 time: 0.195042 Jul 31 20:06:24.299285 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 474/955] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:24 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1573 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:24.909554 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-379b5264-b678-461e-b6ae-0e16c77fe79a tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Action: 'create', calling method: .version_select at 0x7ffa246e4d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1852283637"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:06:25.043791 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-98049704-5b42-477b-87d5-631568a3bcdb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:25.044899 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-98049704-5b42-477b-87d5-631568a3bcdb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:25.047454 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:06:25.052865 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98049704-5b42-477b-87d5-631568a3bcdb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:25.053349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98049704-5b42-477b-87d5-631568a3bcdb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:25.054271 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98049704-5b42-477b-87d5-631568a3bcdb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:25.054883 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98049704-5b42-477b-87d5-631568a3bcdb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:25.205994 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-98049704-5b42-477b-87d5-631568a3bcdb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:25.225351 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-98049704-5b42-477b-87d5-631568a3bcdb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:25.227461 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-98049704-5b42-477b-87d5-631568a3bcdb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:25.229254 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-98049704-5b42-477b-87d5-631568a3bcdb tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.189489 Jul 31 20:06:25.230364 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 475/956] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:25 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:25.246878 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-379b5264-b678-461e-b6ae-0e16c77fe79a tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.463719 Jul 31 20:06:25.248046 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 482/957] 10.222.0.48 () {60 vars in 1155 bytes} [Sun Jul 31 20:06:24 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 466 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 31 20:06:25.262854 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e4685b4f-a2ea-47c5-9088-5039d52cc842 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa247c84c0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:25.283933 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2618cae6-9e13-4860-9f77-d285cb481c6a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:25.286025 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2618cae6-9e13-4860-9f77-d285cb481c6a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:25.293442 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2618cae6-9e13-4860-9f77-d285cb481c6a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:25.293928 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2618cae6-9e13-4860-9f77-d285cb481c6a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:25.294737 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2618cae6-9e13-4860-9f77-d285cb481c6a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:25.295201 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2618cae6-9e13-4860-9f77-d285cb481c6a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:25.318296 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e4685b4f-a2ea-47c5-9088-5039d52cc842 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe" status: 200 len: 345 microversion: 2.1 time: 0.059167 Jul 31 20:06:25.318873 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 476/958] 10.222.0.48 () {58 vars in 1245 bytes} [Sun Jul 31 20:06:25 2022] GET /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:25.324236 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-451e62cb-5607-4aaf-96c0-a66ac064b481 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:25.325081 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-451e62cb-5607-4aaf-96c0-a66ac064b481 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:25.333623 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-451e62cb-5607-4aaf-96c0-a66ac064b481 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:25.334119 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-451e62cb-5607-4aaf-96c0-a66ac064b481 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:25.335179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-451e62cb-5607-4aaf-96c0-a66ac064b481 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:25.336024 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-451e62cb-5607-4aaf-96c0-a66ac064b481 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:25.338125 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2618cae6-9e13-4860-9f77-d285cb481c6a tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058042 Jul 31 20:06:25.339297 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 483/959] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:06:25 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:25.475144 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-451e62cb-5607-4aaf-96c0-a66ac064b481 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:25.483256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-451e62cb-5607-4aaf-96c0-a66ac064b481 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1560 microversion: 2.1 time: 0.163280 Jul 31 20:06:25.483820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 477/960] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:25 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:26.252442 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-01fb4dab-c8af-48a5-9a0d-0f7d0c21fd74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:26.253676 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-01fb4dab-c8af-48a5-9a0d-0f7d0c21fd74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:26.260268 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01fb4dab-c8af-48a5-9a0d-0f7d0c21fd74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:26.260697 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01fb4dab-c8af-48a5-9a0d-0f7d0c21fd74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:26.261475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01fb4dab-c8af-48a5-9a0d-0f7d0c21fd74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:26.261907 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01fb4dab-c8af-48a5-9a0d-0f7d0c21fd74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:26.334098 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c8bcaa7d-f180-431e-91a5-36f2d186db9f tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa247c8550>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:26.396808 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c8bcaa7d-f180-431e-91a5-36f2d186db9f tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe" status: 200 len: 346 microversion: 2.1 time: 0.068423 Jul 31 20:06:26.397775 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 478/961] 10.222.0.48 () {58 vars in 1245 bytes} [Sun Jul 31 20:06:26 2022] GET /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:06:26.403267 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e182e339-f983-4e87-9bd2-ae2552b43674 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:26.407352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e182e339-f983-4e87-9bd2-ae2552b43674 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:26.417053 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e182e339-f983-4e87-9bd2-ae2552b43674 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:26.417821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e182e339-f983-4e87-9bd2-ae2552b43674 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:26.418784 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e182e339-f983-4e87-9bd2-ae2552b43674 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:26.419433 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e182e339-f983-4e87-9bd2-ae2552b43674 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:26.439879 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-01fb4dab-c8af-48a5-9a0d-0f7d0c21fd74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:26.448065 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-01fb4dab-c8af-48a5-9a0d-0f7d0c21fd74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:26.449688 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-01fb4dab-c8af-48a5-9a0d-0f7d0c21fd74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:26.451038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-01fb4dab-c8af-48a5-9a0d-0f7d0c21fd74 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.202511 Jul 31 20:06:26.451568 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 484/962] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:26 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:26.454890 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e182e339-f983-4e87-9bd2-ae2552b43674 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055784 Jul 31 20:06:26.461028 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 479/963] 10.222.0.48 () {58 vars in 1302 bytes} [Sun Jul 31 20:06:26 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 20:06:26.465193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3cb5d80a-fe93-498c-824a-aeee4d3fa62d tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Action: 'create', calling method: .version_select at 0x7ffa24699dc0>, body: {"snapshot": {"volume_id": "5f45b115-ca2b-4745-9e5c-685c196448fe", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-847289402"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:06:26.521383 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1342d2ee-379f-4489-a849-1693a3bd4fe4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:26.522121 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1342d2ee-379f-4489-a849-1693a3bd4fe4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:26.529796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1342d2ee-379f-4489-a849-1693a3bd4fe4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:26.530505 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1342d2ee-379f-4489-a849-1693a3bd4fe4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:26.531446 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1342d2ee-379f-4489-a849-1693a3bd4fe4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:26.532154 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1342d2ee-379f-4489-a849-1693a3bd4fe4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:26.561243 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1342d2ee-379f-4489-a849-1693a3bd4fe4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:06:26.654116 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1342d2ee-379f-4489-a849-1693a3bd4fe4 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 204 len: 0 microversion: 2.1 time: 0.136867 Jul 31 20:06:26.654725 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 480/964] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:06:26 2022] DELETE /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:06:26.664627 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1e9bebe9-be13-4eb4-8e01-49d4991cefa0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:26.665571 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1e9bebe9-be13-4eb4-8e01-49d4991cefa0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:26.672200 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e9bebe9-be13-4eb4-8e01-49d4991cefa0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:26.672950 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e9bebe9-be13-4eb4-8e01-49d4991cefa0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:26.673912 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e9bebe9-be13-4eb4-8e01-49d4991cefa0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:26.674602 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e9bebe9-be13-4eb4-8e01-49d4991cefa0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:26.675542 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3cb5d80a-fe93-498c-824a-aeee4d3fa62d tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.222636 Jul 31 20:06:26.676133 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 485/965] 10.222.0.48 () {60 vars in 1162 bytes} [Sun Jul 31 20:06:26 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:26.686891 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b1eba486-0965-496e-b757-7c5b4d58004e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa2907dee0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:26.718661 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b1eba486-0965-496e-b757-7c5b4d58004e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5" status: 200 len: 286 microversion: 2.1 time: 0.035697 Jul 31 20:06:26.719219 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 486/966] 10.222.0.48 () {58 vars in 1251 bytes} [Sun Jul 31 20:06:26 2022] GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:26.730024 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cd436637-d84d-4eb5-9f67-6a58298842b5 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa2907da60>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:26.760712 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cd436637-d84d-4eb5-9f67-6a58298842b5 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034355 Jul 31 20:06:26.761303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 487/967] 10.222.0.48 () {58 vars in 1140 bytes} [Sun Jul 31 20:06:26 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:26.772292 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8d961c55-b054-44fa-8051-0d885986257e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa2907d3a0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:26.802519 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8d961c55-b054-44fa-8051-0d885986257e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5" status: 200 len: 286 microversion: 2.1 time: 0.033753 Jul 31 20:06:26.803045 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 488/968] 10.222.0.48 () {58 vars in 1251 bytes} [Sun Jul 31 20:06:26 2022] GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:06:26.817444 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1e9bebe9-be13-4eb4-8e01-49d4991cefa0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:26.825440 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1e9bebe9-be13-4eb4-8e01-49d4991cefa0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1681 microversion: 2.1 time: 0.165888 Jul 31 20:06:26.826119 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 481/969] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:26 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:06:27.480166 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-196f3a6a-e56b-4613-96d6-f3b6a172138c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:27.481039 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-196f3a6a-e56b-4613-96d6-f3b6a172138c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:27.490087 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-196f3a6a-e56b-4613-96d6-f3b6a172138c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:27.490528 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-196f3a6a-e56b-4613-96d6-f3b6a172138c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:27.491281 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-196f3a6a-e56b-4613-96d6-f3b6a172138c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:27.491705 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-196f3a6a-e56b-4613-96d6-f3b6a172138c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:27.496523 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:06:27.628560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-196f3a6a-e56b-4613-96d6-f3b6a172138c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:27.636792 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-196f3a6a-e56b-4613-96d6-f3b6a172138c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:27.638327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-196f3a6a-e56b-4613-96d6-f3b6a172138c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:27.639484 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-196f3a6a-e56b-4613-96d6-f3b6a172138c tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.166790 Jul 31 20:06:27.640103 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 489/970] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:27 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:27.815256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-82cebeb6-b4ba-4113-9d4e-75555966c62e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa246a6940>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:27.845447 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-82cebeb6-b4ba-4113-9d4e-75555966c62e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5" status: 200 len: 286 microversion: 2.1 time: 0.034375 Jul 31 20:06:27.846074 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 482/971] 10.222.0.48 () {58 vars in 1251 bytes} [Sun Jul 31 20:06:27 2022] GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:27.847865 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0216c568-a3e2-4d91-9c61-b701f8730eed tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:27.848466 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0216c568-a3e2-4d91-9c61-b701f8730eed tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:27.854499 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0216c568-a3e2-4d91-9c61-b701f8730eed tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:27.854953 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0216c568-a3e2-4d91-9c61-b701f8730eed tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:27.855708 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0216c568-a3e2-4d91-9c61-b701f8730eed tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:27.856133 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0216c568-a3e2-4d91-9c61-b701f8730eed tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:27.993102 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0216c568-a3e2-4d91-9c61-b701f8730eed tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:28.004796 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0216c568-a3e2-4d91-9c61-b701f8730eed tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1681 microversion: 2.1 time: 0.160760 Jul 31 20:06:28.005416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 490/972] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:27 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:06:28.667109 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e17d2d81-03e2-400b-89c1-3119c0cb4c67 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:28.668104 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e17d2d81-03e2-400b-89c1-3119c0cb4c67 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:28.678651 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e17d2d81-03e2-400b-89c1-3119c0cb4c67 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:28.679434 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e17d2d81-03e2-400b-89c1-3119c0cb4c67 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:28.680652 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e17d2d81-03e2-400b-89c1-3119c0cb4c67 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:28.681426 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e17d2d81-03e2-400b-89c1-3119c0cb4c67 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:28.844328 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e17d2d81-03e2-400b-89c1-3119c0cb4c67 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:28.852579 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e17d2d81-03e2-400b-89c1-3119c0cb4c67 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:28.854229 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e17d2d81-03e2-400b-89c1-3119c0cb4c67 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:28.855724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e17d2d81-03e2-400b-89c1-3119c0cb4c67 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.195043 Jul 31 20:06:28.869223 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 483/973] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:28 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:28.869913 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-76b1ef54-1294-4e6f-b99b-e039e86c6d1b tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa246e1280>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:28.889280 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-76b1ef54-1294-4e6f-b99b-e039e86c6d1b tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5" status: 200 len: 286 microversion: 2.1 time: 0.034797 Jul 31 20:06:28.890469 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 491/974] 10.222.0.48 () {58 vars in 1251 bytes} [Sun Jul 31 20:06:28 2022] GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:06:28.956144 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-d125ed4a-4f70-4548-b9ff-39aef3bf92b0 req-d9e58c6f-0a67-42e8-9158-8a13bad6e7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86192351-1ad0-4d52-8496-e85d6e5381dd", "name": "network-vif-plugged", "status": "completed", "tag": "dc71e4bb-0c50-46be-9265-95e6a82b855e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:06:28.967420 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d125ed4a-4f70-4548-b9ff-39aef3bf92b0 req-d9e58c6f-0a67-42e8-9158-8a13bad6e7b8 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:28.968279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d125ed4a-4f70-4548-b9ff-39aef3bf92b0 req-d9e58c6f-0a67-42e8-9158-8a13bad6e7b8 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:28.984360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-d125ed4a-4f70-4548-b9ff-39aef3bf92b0 req-d9e58c6f-0a67-42e8-9158-8a13bad6e7b8 service nova] Creating event network-vif-plugged:dc71e4bb-0c50-46be-9265-95e6a82b855e for instance 86192351-1ad0-4d52-8496-e85d6e5381dd on hv-cinder-84984 Jul 31 20:06:28.990562 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-d125ed4a-4f70-4548-b9ff-39aef3bf92b0 req-d9e58c6f-0a67-42e8-9158-8a13bad6e7b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037911 Jul 31 20:06:28.991615 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 484/975] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:29.026817 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e4d75033-cbe1-4dd9-89f0-5530e226fc33 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:29.027429 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e4d75033-cbe1-4dd9-89f0-5530e226fc33 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:29.033880 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4d75033-cbe1-4dd9-89f0-5530e226fc33 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:29.034323 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4d75033-cbe1-4dd9-89f0-5530e226fc33 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:29.035086 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4d75033-cbe1-4dd9-89f0-5530e226fc33 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:29.035539 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4d75033-cbe1-4dd9-89f0-5530e226fc33 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:29.172200 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e4d75033-cbe1-4dd9-89f0-5530e226fc33 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:29.180091 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e4d75033-cbe1-4dd9-89f0-5530e226fc33 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1681 microversion: 2.1 time: 0.157693 Jul 31 20:06:29.180649 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 492/976] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:29 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:29.880772 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-11230d11-f989-4bca-9597-55aca134ff35 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:29.881520 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-11230d11-f989-4bca-9597-55aca134ff35 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:29.888633 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11230d11-f989-4bca-9597-55aca134ff35 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:29.889070 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11230d11-f989-4bca-9597-55aca134ff35 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:29.889857 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11230d11-f989-4bca-9597-55aca134ff35 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:29.890281 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11230d11-f989-4bca-9597-55aca134ff35 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:29.902257 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bad87123-46a0-4c55-bd72-a9075e31e9c0 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa246e1940>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:29.934033 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bad87123-46a0-4c55-bd72-a9075e31e9c0 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5" status: 200 len: 286 microversion: 2.1 time: 0.035650 Jul 31 20:06:29.937535 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 493/977] 10.222.0.48 () {58 vars in 1251 bytes} [Sun Jul 31 20:06:29 2022] GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:06:30.032929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-11230d11-f989-4bca-9597-55aca134ff35 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:30.042404 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-11230d11-f989-4bca-9597-55aca134ff35 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:30.043906 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-11230d11-f989-4bca-9597-55aca134ff35 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:30.045070 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-11230d11-f989-4bca-9597-55aca134ff35 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.168744 Jul 31 20:06:30.045666 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 485/978] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:29 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:30.202271 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e1a56a72-d141-48df-b749-eeb2ec4bbb2d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:30.202876 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e1a56a72-d141-48df-b749-eeb2ec4bbb2d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:30.209667 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1a56a72-d141-48df-b749-eeb2ec4bbb2d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:30.210311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1a56a72-d141-48df-b749-eeb2ec4bbb2d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:30.211216 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1a56a72-d141-48df-b749-eeb2ec4bbb2d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:30.211813 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1a56a72-d141-48df-b749-eeb2ec4bbb2d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:30.348206 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e1a56a72-d141-48df-b749-eeb2ec4bbb2d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:30.359822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e1a56a72-d141-48df-b749-eeb2ec4bbb2d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1681 microversion: 2.1 time: 0.161442 Jul 31 20:06:30.360630 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 494/979] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:30 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:30.946104 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a87d6def-aa3d-471b-8a86-ce50d9de977f tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa24aeba60>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:30.976563 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a87d6def-aa3d-471b-8a86-ce50d9de977f tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5" status: 200 len: 287 microversion: 2.1 time: 0.034260 Jul 31 20:06:30.977130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 486/980] 10.222.0.48 () {58 vars in 1251 bytes} [Sun Jul 31 20:06:30 2022] GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:30.988064 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a38b8ddd-5b65-4579-b6af-02fa6ef9c71f tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa2474d160>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:31.055274 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a38b8ddd-5b65-4579-b6af-02fa6ef9c71f tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5" status: 202 len: 0 microversion: 2.1 time: 0.070675 Jul 31 20:06:31.055913 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 495/981] 10.222.0.48 () {58 vars in 1254 bytes} [Sun Jul 31 20:06:30 2022] DELETE /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:06:31.064467 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1a981fcd-0e01-491b-a73d-f4ac377dfb16 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa2495de50>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:31.068409 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-80990fba-d08f-4990-9b9c-bb1b35101547 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:31.069024 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-80990fba-d08f-4990-9b9c-bb1b35101547 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:31.076496 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80990fba-d08f-4990-9b9c-bb1b35101547 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:31.076982 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80990fba-d08f-4990-9b9c-bb1b35101547 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:31.077747 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80990fba-d08f-4990-9b9c-bb1b35101547 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:31.078511 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80990fba-d08f-4990-9b9c-bb1b35101547 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:31.094470 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1a981fcd-0e01-491b-a73d-f4ac377dfb16 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5" status: 200 len: 286 microversion: 2.1 time: 0.034143 Jul 31 20:06:31.099743 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 487/982] 10.222.0.48 () {58 vars in 1251 bytes} [Sun Jul 31 20:06:31 2022] GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:31.363678 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-80990fba-d08f-4990-9b9c-bb1b35101547 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:31.374815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-80990fba-d08f-4990-9b9c-bb1b35101547 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:31.376893 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-80990fba-d08f-4990-9b9c-bb1b35101547 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:31.378887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-80990fba-d08f-4990-9b9c-bb1b35101547 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1731 microversion: 2.20 time: 0.315052 Jul 31 20:06:31.379683 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 496/983] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:31 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1731 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 20:06:31.388142 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-906e1797-3dc0-4e05-b5d9-ad2d90cb406e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:31.389175 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-906e1797-3dc0-4e05-b5d9-ad2d90cb406e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:31.396657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-906e1797-3dc0-4e05-b5d9-ad2d90cb406e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:31.397261 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-906e1797-3dc0-4e05-b5d9-ad2d90cb406e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:31.398147 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-906e1797-3dc0-4e05-b5d9-ad2d90cb406e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:31.398702 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-906e1797-3dc0-4e05-b5d9-ad2d90cb406e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:31.613563 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-906e1797-3dc0-4e05-b5d9-ad2d90cb406e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b9c24c8dc94af8b2c8e44be8494e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f435e60769a43deb3c15b351f97d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:31.623502 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-906e1797-3dc0-4e05-b5d9-ad2d90cb406e tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 200 len: 1681 microversion: 2.1 time: 0.239642 Jul 31 20:06:31.624263 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 488/984] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:31 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:06:31.911928 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-8af947e0-932b-43ab-8184-e1a2d7f5f2f9 req-13000d8f-1e8a-442e-a173-fb79bc11bd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa", "name": "network-vif-deleted", "tag": "ea9ca6e8-81a9-4578-b567-6dc73d9650ec"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:06:31.924495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8af947e0-932b-43ab-8184-e1a2d7f5f2f9 req-13000d8f-1e8a-442e-a173-fb79bc11bd56 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:31.925411 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8af947e0-932b-43ab-8184-e1a2d7f5f2f9 req-13000d8f-1e8a-442e-a173-fb79bc11bd56 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:31.940151 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-8af947e0-932b-43ab-8184-e1a2d7f5f2f9 req-13000d8f-1e8a-442e-a173-fb79bc11bd56 service nova] Creating event network-vif-deleted:ea9ca6e8-81a9-4578-b567-6dc73d9650ec for instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa on hv-cinder-84984 Jul 31 20:06:31.948272 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-8af947e0-932b-43ab-8184-e1a2d7f5f2f9 req-13000d8f-1e8a-442e-a173-fb79bc11bd56 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041093 Jul 31 20:06:31.953614 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 497/985] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:06:32.115424 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-30bb46d8-3040-48b1-91eb-6958c40846f3 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa24889550>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:32.147750 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-30bb46d8-3040-48b1-91eb-6958c40846f3 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] HTTP exception thrown: Snapshot 75836e2d-7de6-4a73-84c9-128fd8740ee5 could not be found. Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-30bb46d8-3040-48b1-91eb-6958c40846f3 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Request method failure captured: Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5 HTTP/1.1 Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5uDAg-e5-YezAS2aNkjEruwrvP6NIsDHApargfkykoaAM4W2fL6KZpa1kWCMFcaUGzqcklORjW_GLAqvAvsCGFUokdpaY2wm5QgOoW1yFA0Dfezmm12n8GMig_uRBOowTiEYYcSkjshJz1XGE-zo-Y57RNKWvCW66UUXBs-7rqS4FcQ Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 9cebbb46967a4525a96ddc94b0e1fd20 Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-974704499 Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:06:32.150138 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:06:32.151566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9cebbb46967a4525a96ddc94b0e1fd20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9cebbb46967a4525a96ddc94b0e1fd20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9cebbb46967a4525a96ddc94b0e1fd20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9cebbb46967a4525a96ddc94b0e1fd20"}]}] Jul 31 20:06:32.151566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-974704499 Jul 31 20:06:32.151566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 9cebbb46967a4525a96ddc94b0e1fd20 Jul 31 20:06:32.151566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-974704499 Jul 31 20:06:32.151566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesSnapshotsTestJSON-974704499-project Jul 31 20:06:32.151566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:06:32.151566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:06:32.151566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: c35d35425e7b404a8070a8a201b8b36f Jul 31 20:06:32.151566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-974704499-project Jul 31 20:06:32.151566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: Jul 31 20:06:32.151566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Snapshot 75836e2d-7de6-4a73-84c9-128fd8740ee5 could not be found. Jul 31 20:06:32.151566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '75836e2d-7de6-4a73-84c9-128fd8740ee5'} Jul 31 20:06:32.151566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 75836e2d-7de6-4a73-84c9-128fd8740ee5 could not be found. (HTTP 404) (Request-ID: req-71fba90e-fa3e-4877-b608-861b8e803160) Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:32.152408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 20:06:32.154478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 75836e2d-7de6-4a73-84c9-128fd8740ee5 could not be found. Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 31 20:06:32.157202 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 75836e2d-7de6-4a73-84c9-128fd8740ee5 could not be found. Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 75836e2d-7de6-4a73-84c9-128fd8740ee5 could not be found. Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-30bb46d8-3040-48b1-91eb-6958c40846f3 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Returning 404 to user: Snapshot 75836e2d-7de6-4a73-84c9-128fd8740ee5 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-30bb46d8-3040-48b1-91eb-6958c40846f3 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5" status: 404 len: 111 microversion: 2.1 time: 0.045696 Jul 31 20:06:32.160483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 489/986] 10.222.0.48 () {58 vars in 1251 bytes} [Sun Jul 31 20:06:32 2022] GET /compute/v2.1/os-snapshots/75836e2d-7de6-4a73-84c9-128fd8740ee5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:32.163203 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b50025d8-e31d-463b-8100-234331654fa2 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa2907ddc0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:32.227277 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b50025d8-e31d-463b-8100-234331654fa2 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe" status: 202 len: 0 microversion: 2.1 time: 0.070426 Jul 31 20:06:32.227936 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 498/987] 10.222.0.48 () {58 vars in 1248 bytes} [Sun Jul 31 20:06:32 2022] DELETE /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 20:06:32.236738 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-55b6670b-65b9-4337-b77c-210fd6cb7b25 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa24b1daf0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:32.287645 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-55b6670b-65b9-4337-b77c-210fd6cb7b25 tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe" status: 200 len: 345 microversion: 2.1 time: 0.055239 Jul 31 20:06:32.288188 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 490/988] 10.222.0.48 () {58 vars in 1245 bytes} [Sun Jul 31 20:06:32 2022] GET /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:06:32.404234 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-56dea30a-a042-4e45-85cf-0e4c0a06b1b3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:32.405065 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-56dea30a-a042-4e45-85cf-0e4c0a06b1b3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:32.429032 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-56dea30a-a042-4e45-85cf-0e4c0a06b1b3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:32.440431 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-56dea30a-a042-4e45-85cf-0e4c0a06b1b3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:32.442018 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-56dea30a-a042-4e45-85cf-0e4c0a06b1b3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:32.444092 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-56dea30a-a042-4e45-85cf-0e4c0a06b1b3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:32.616573 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-56dea30a-a042-4e45-85cf-0e4c0a06b1b3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:32.630727 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-56dea30a-a042-4e45-85cf-0e4c0a06b1b3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:32.636477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-56dea30a-a042-4e45-85cf-0e4c0a06b1b3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:32.637990 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-56dea30a-a042-4e45-85cf-0e4c0a06b1b3 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1718 microversion: 2.20 time: 0.237813 Jul 31 20:06:32.638608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 499/989] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:06:32 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1718 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:06:32.646082 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-411ef397-ab31-41f8-9377-2bb5d9d2cf7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:32.646658 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-411ef397-ab31-41f8-9377-2bb5d9d2cf7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:32.652892 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-411ef397-ab31-41f8-9377-2bb5d9d2cf7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:32.653383 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-411ef397-ab31-41f8-9377-2bb5d9d2cf7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:32.654274 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-411ef397-ab31-41f8-9377-2bb5d9d2cf7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:32.654712 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-411ef397-ab31-41f8-9377-2bb5d9d2cf7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:32.671717 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-411ef397-ab31-41f8-9377-2bb5d9d2cf7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-411ef397-ab31-41f8-9377-2bb5d9d2cf7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa HTTP/1.1 Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:06:32.673504 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:06:32.675167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:06:32.675167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:32.675167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:32.675167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:32.675167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:32.675167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:06:32.675167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:06:32.675167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:06:32.675167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:32.675167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:06:32.675167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:32.675167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa'} Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:32.676076 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:32.677675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:32.679165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-411ef397-ab31-41f8-9377-2bb5d9d2cf7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 404 to user: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:32.679165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-411ef397-ab31-41f8-9377-2bb5d9d2cf7d tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 404 len: 111 microversion: 2.1 time: 0.033700 Jul 31 20:06:32.679165 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 491/990] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:32 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:32.686716 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a51535e4-0ece-4353-9584-3cee7843dcb0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '.version_select at 0x7ffa246e4c10>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:32.716542 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a51535e4-0ece-4353-9584-3cee7843dcb0 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918598570" status: 202 len: 0 microversion: 2.1 time: 0.034314 Jul 31 20:06:32.717030 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 500/991] 10.222.0.48 () {58 vars in 1221 bytes} [Sun Jul 31 20:06:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918598570 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:06:33.302396 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e7273fc4-3ad1-4b24-a483-4190042b6e8e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa247f91f0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:33.333328 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-e7273fc4-3ad1-4b24-a483-4190042b6e8e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] HTTP exception thrown: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e7273fc4-3ad1-4b24-a483-4190042b6e8e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Request method failure captured: Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe HTTP/1.1 Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5uDAg-e5-YezAS2aNkjEruwrvP6NIsDHApargfkykoaAM4W2fL6KZpa1kWCMFcaUGzqcklORjW_GLAqvAvsCGFUokdpaY2wm5QgOoW1yFA0Dfezmm12n8GMig_uRBOowTiEYYcSkjshJz1XGE-zo-Y57RNKWvCW66UUXBs-7rqS4FcQ Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 9cebbb46967a4525a96ddc94b0e1fd20 Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-974704499 Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:06:33.335349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:06:33.336803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9cebbb46967a4525a96ddc94b0e1fd20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9cebbb46967a4525a96ddc94b0e1fd20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9cebbb46967a4525a96ddc94b0e1fd20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9cebbb46967a4525a96ddc94b0e1fd20"}]}] Jul 31 20:06:33.336803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-974704499 Jul 31 20:06:33.336803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 9cebbb46967a4525a96ddc94b0e1fd20 Jul 31 20:06:33.336803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-974704499 Jul 31 20:06:33.336803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesSnapshotsTestJSON-974704499-project Jul 31 20:06:33.336803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:06:33.336803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:06:33.336803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: c35d35425e7b404a8070a8a201b8b36f Jul 31 20:06:33.336803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-974704499-project Jul 31 20:06:33.336803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: Jul 31 20:06:33.336803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.336803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '5f45b115-ca2b-4745-9e5c-685c196448fe'} Jul 31 20:06:33.336803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. (HTTP 404) (Request-ID: req-03be49bd-8efd-496c-a194-4f41abc16728) Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:33.337746 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 20:06:33.339027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 20:06:33.340237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:33.341640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.341640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.341640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:33.341640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.341640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:33.341640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:33.341640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:33.341640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:33.341640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:33.341640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.341640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.341640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e7273fc4-3ad1-4b24-a483-4190042b6e8e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Returning 404 to user: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:33.341640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e7273fc4-3ad1-4b24-a483-4190042b6e8e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe" status: 404 len: 109 microversion: 2.1 time: 0.039027 Jul 31 20:06:33.348139 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 492/992] 10.222.0.48 () {58 vars in 1245 bytes} [Sun Jul 31 20:06:33 2022] GET /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:33.353627 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cea13454-2767-48e2-861b-1aa9ac45027f tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa24699820>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:33.381927 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-cea13454-2767-48e2-861b-1aa9ac45027f tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] HTTP exception thrown: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cea13454-2767-48e2-861b-1aa9ac45027f tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Request method failure captured: Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe HTTP/1.1 Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5uDAg-e5-YezAS2aNkjEruwrvP6NIsDHApargfkykoaAM4W2fL6KZpa1kWCMFcaUGzqcklORjW_GLAqvAvsCGFUokdpaY2wm5QgOoW1yFA0Dfezmm12n8GMig_uRBOowTiEYYcSkjshJz1XGE-zo-Y57RNKWvCW66UUXBs-7rqS4FcQ Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 9cebbb46967a4525a96ddc94b0e1fd20 Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-974704499 Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:06:33.384001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:06:33.385805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9cebbb46967a4525a96ddc94b0e1fd20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9cebbb46967a4525a96ddc94b0e1fd20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9cebbb46967a4525a96ddc94b0e1fd20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9cebbb46967a4525a96ddc94b0e1fd20"}]}] Jul 31 20:06:33.385805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotsTestJSON-974704499 Jul 31 20:06:33.385805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 9cebbb46967a4525a96ddc94b0e1fd20 Jul 31 20:06:33.385805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-974704499 Jul 31 20:06:33.385805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotsTestJSON-974704499-project Jul 31 20:06:33.385805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:06:33.385805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:06:33.385805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: c35d35425e7b404a8070a8a201b8b36f Jul 31 20:06:33.385805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotsTestJSON-974704499-project Jul 31 20:06:33.385805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: Jul 31 20:06:33.385805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.385805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': '5f45b115-ca2b-4745-9e5c-685c196448fe'} Jul 31 20:06:33.385805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. (HTTP 404) (Request-ID: req-ba0544ec-916f-4e26-88b5-476597de5d90) Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:33.386815 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 20:06:33.388303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 31 20:06:33.389757 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cea13454-2767-48e2-861b-1aa9ac45027f tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Returning 404 to user: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cea13454-2767-48e2-861b-1aa9ac45027f tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe" status: 404 len: 109 microversion: 2.1 time: 0.036295 Jul 31 20:06:33.391038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 501/993] 10.222.0.48 () {58 vars in 1248 bytes} [Sun Jul 31 20:06:33 2022] DELETE /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 20:06:33.395551 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-91ee143f-00a2-4a02-9e83-2c249034210e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Calling method '.version_select at 0x7ffa248898b0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:33.430653 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-91ee143f-00a2-4a02-9e83-2c249034210e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] HTTP exception thrown: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-91ee143f-00a2-4a02-9e83-2c249034210e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Request method failure captured: Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe HTTP/1.1 Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5uDAg-e5-YezAS2aNkjEruwrvP6NIsDHApargfkykoaAM4W2fL6KZpa1kWCMFcaUGzqcklORjW_GLAqvAvsCGFUokdpaY2wm5QgOoW1yFA0Dfezmm12n8GMig_uRBOowTiEYYcSkjshJz1XGE-zo-Y57RNKWvCW66UUXBs-7rqS4FcQ Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 9cebbb46967a4525a96ddc94b0e1fd20 Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-974704499 Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:06:33.432608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:06:33.434136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9cebbb46967a4525a96ddc94b0e1fd20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9cebbb46967a4525a96ddc94b0e1fd20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9cebbb46967a4525a96ddc94b0e1fd20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9cebbb46967a4525a96ddc94b0e1fd20"}]}] Jul 31 20:06:33.434136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-974704499 Jul 31 20:06:33.434136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 9cebbb46967a4525a96ddc94b0e1fd20 Jul 31 20:06:33.434136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-974704499 Jul 31 20:06:33.434136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesSnapshotsTestJSON-974704499-project Jul 31 20:06:33.434136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:06:33.434136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:06:33.434136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: c35d35425e7b404a8070a8a201b8b36f Jul 31 20:06:33.434136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-974704499-project Jul 31 20:06:33.434136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: Jul 31 20:06:33.434136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.434136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '5f45b115-ca2b-4745-9e5c-685c196448fe'} Jul 31 20:06:33.434136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. (HTTP 404) (Request-ID: req-e6c18e1a-d9c5-4d63-a5c1-fb71341a4703) Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:33.435136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 20:06:33.436256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 20:06:33.437814 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-91ee143f-00a2-4a02-9e83-2c249034210e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] Returning 404 to user: Volume 5f45b115-ca2b-4745-9e5c-685c196448fe could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-91ee143f-00a2-4a02-9e83-2c249034210e tempest-VolumesSnapshotsTestJSON-974704499 tempest-VolumesSnapshotsTestJSON-974704499-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe" status: 404 len: 109 microversion: 2.1 time: 0.043638 Jul 31 20:06:33.439306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 493/994] 10.222.0.48 () {58 vars in 1245 bytes} [Sun Jul 31 20:06:33 2022] GET /compute/v2.1/os-volumes/5f45b115-ca2b-4745-9e5c-685c196448fe => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:34.500416 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6e2b8b43-d9c8-4e07-846d-43eb9ca63432 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:34.501227 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6e2b8b43-d9c8-4e07-846d-43eb9ca63432 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:34.508853 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e2b8b43-d9c8-4e07-846d-43eb9ca63432 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:34.509339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e2b8b43-d9c8-4e07-846d-43eb9ca63432 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:34.510112 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e2b8b43-d9c8-4e07-846d-43eb9ca63432 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:34.510564 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e2b8b43-d9c8-4e07-846d-43eb9ca63432 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:34.524339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-6e2b8b43-d9c8-4e07-846d-43eb9ca63432 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6e2b8b43-d9c8-4e07-846d-43eb9ca63432 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa HTTP/1.1 Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:06:34.525931 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:06:34.527461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:06:34.527461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:34.527461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:34.527461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:34.527461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:34.527461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:06:34.527461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:06:34.527461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:06:34.527461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:34.527461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:06:34.527461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:34.527461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': '8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa'} Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:34.528556 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:34.529986 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:34.531471 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6e2b8b43-d9c8-4e07-846d-43eb9ca63432 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 404 to user: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:34.531471 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6e2b8b43-d9c8-4e07-846d-43eb9ca63432 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 404 len: 111 microversion: 2.1 time: 0.036155 Jul 31 20:06:34.531471 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 502/995] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:06:34 2022] DELETE /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:34.536761 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-77ec27ad-f621-49a2-8a77-d2334168d55c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:34.537390 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-77ec27ad-f621-49a2-8a77-d2334168d55c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:34.543439 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77ec27ad-f621-49a2-8a77-d2334168d55c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:34.543883 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77ec27ad-f621-49a2-8a77-d2334168d55c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:34.544770 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77ec27ad-f621-49a2-8a77-d2334168d55c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:34.545234 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77ec27ad-f621-49a2-8a77-d2334168d55c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:34.559211 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-77ec27ad-f621-49a2-8a77-d2334168d55c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-77ec27ad-f621-49a2-8a77-d2334168d55c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa HTTP/1.1 Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:06:34.560672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:06:34.562040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:06:34.562040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:34.562040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:34.562040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:34.562040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:34.562040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:06:34.562040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:06:34.562040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:06:34.562040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:34.562040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:06:34.562040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:34.562040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa'} Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:34.562955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. Jul 31 20:06:34.564240 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:34.565561 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-77ec27ad-f621-49a2-8a77-d2334168d55c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 404 to user: Instance 8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:34.565561 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-77ec27ad-f621-49a2-8a77-d2334168d55c tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa" status: 404 len: 111 microversion: 2.1 time: 0.029889 Jul 31 20:06:34.565561 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 494/996] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:34 2022] GET /compute/v2.1/servers/8c10b18d-44f3-496c-8b0f-ba24cf2ba2fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:35.710965 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-38e7d84d-b488-4b13-9017-76f52d9a1e93 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:35.711630 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-38e7d84d-b488-4b13-9017-76f52d9a1e93 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:35.719009 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38e7d84d-b488-4b13-9017-76f52d9a1e93 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:35.719461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38e7d84d-b488-4b13-9017-76f52d9a1e93 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:35.720232 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38e7d84d-b488-4b13-9017-76f52d9a1e93 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:35.720660 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38e7d84d-b488-4b13-9017-76f52d9a1e93 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:35.735280 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-38e7d84d-b488-4b13-9017-76f52d9a1e93 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-38e7d84d-b488-4b13-9017-76f52d9a1e93 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 HTTP/1.1 Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:06:35.737370 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:06:35.738996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:06:35.738996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:35.738996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:35.738996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:35.738996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:35.738996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:06:35.738996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:06:35.738996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:06:35.738996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:35.738996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:06:35.738996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:06:35.738996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': 'e30cd600-cded-49be-97de-e78bdff544b8'} Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:35.739822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:06:35.741001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.742667 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-38e7d84d-b488-4b13-9017-76f52d9a1e93 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 404 to user: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:35.742667 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-38e7d84d-b488-4b13-9017-76f52d9a1e93 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 404 len: 111 microversion: 2.1 time: 0.032344 Jul 31 20:06:35.742667 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 503/997] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:06:35 2022] DELETE /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:35.749128 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1a71dd1d-83d4-4cd0-844c-3a127969e641 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:35.749774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1a71dd1d-83d4-4cd0-844c-3a127969e641 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: e30cd600-cded-49be-97de-e78bdff544b8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:35.756665 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a71dd1d-83d4-4cd0-844c-3a127969e641 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:35.756968 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a71dd1d-83d4-4cd0-844c-3a127969e641 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:35.758331 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a71dd1d-83d4-4cd0-844c-3a127969e641 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:35.759144 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a71dd1d-83d4-4cd0-844c-3a127969e641 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:35.775804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-1a71dd1d-83d4-4cd0-844c-3a127969e641 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1a71dd1d-83d4-4cd0-844c-3a127969e641 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 HTTP/1.1 Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:06:35.777459 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:06:35.778807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:06:35.778807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:35.778807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:35.778807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:35.778807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:35.778807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:06:35.778807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:06:35.778807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:06:35.778807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:35.778807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:06:35.778807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:06:35.778807 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': 'e30cd600-cded-49be-97de-e78bdff544b8'} Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:35.779555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. Jul 31 20:06:35.781330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.782451 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1a71dd1d-83d4-4cd0-844c-3a127969e641 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 404 to user: Instance e30cd600-cded-49be-97de-e78bdff544b8 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:35.782451 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1a71dd1d-83d4-4cd0-844c-3a127969e641 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8" status: 404 len: 111 microversion: 2.1 time: 0.035359 Jul 31 20:06:35.785236 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 495/998] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:35 2022] GET /compute/v2.1/servers/e30cd600-cded-49be-97de-e78bdff544b8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:35.788173 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c98e4f0e-1c3c-42c6-994b-1434a96c6fd8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:35.788530 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c98e4f0e-1c3c-42c6-994b-1434a96c6fd8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:35.795923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c98e4f0e-1c3c-42c6-994b-1434a96c6fd8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:35.796375 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c98e4f0e-1c3c-42c6-994b-1434a96c6fd8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:35.797169 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c98e4f0e-1c3c-42c6-994b-1434a96c6fd8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:35.797625 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c98e4f0e-1c3c-42c6-994b-1434a96c6fd8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:35.811518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-c98e4f0e-1c3c-42c6-994b-1434a96c6fd8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c98e4f0e-1c3c-42c6-994b-1434a96c6fd8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d HTTP/1.1 Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:06:35.813090 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:06:35.814730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:06:35.814730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:35.814730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:35.814730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:35.814730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:35.814730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:06:35.814730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:06:35.814730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:06:35.814730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:35.814730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:06:35.814730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:06:35.814730 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': 'feed8b88-8df9-44a5-9520-0d723924fd1d'} Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:35.815632 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:06:35.817142 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.818740 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c98e4f0e-1c3c-42c6-994b-1434a96c6fd8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 404 to user: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:35.818740 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c98e4f0e-1c3c-42c6-994b-1434a96c6fd8 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 404 len: 111 microversion: 2.1 time: 0.030376 Jul 31 20:06:35.818740 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 504/999] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:06:35 2022] DELETE /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:35.823254 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b9cbd531-0226-4bc9-a4de-9e1afa7ae6a2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:35.823869 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b9cbd531-0226-4bc9-a4de-9e1afa7ae6a2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: feed8b88-8df9-44a5-9520-0d723924fd1d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:35.829994 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b9cbd531-0226-4bc9-a4de-9e1afa7ae6a2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:35.830555 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b9cbd531-0226-4bc9-a4de-9e1afa7ae6a2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:35.831330 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b9cbd531-0226-4bc9-a4de-9e1afa7ae6a2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:35.831766 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b9cbd531-0226-4bc9-a4de-9e1afa7ae6a2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:35.846499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-b9cbd531-0226-4bc9-a4de-9e1afa7ae6a2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b9cbd531-0226-4bc9-a4de-9e1afa7ae6a2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d HTTP/1.1 Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:06:35.848347 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:06:35.849965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:06:35.849965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:35.849965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:35.849965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:35.849965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:35.849965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:06:35.849965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:06:35.849965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:06:35.849965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:35.849965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:06:35.849965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:06:35.849965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': 'feed8b88-8df9-44a5-9520-0d723924fd1d'} Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:35.850886 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. Jul 31 20:06:35.852384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:35.853881 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b9cbd531-0226-4bc9-a4de-9e1afa7ae6a2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 404 to user: Instance feed8b88-8df9-44a5-9520-0d723924fd1d could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:35.853881 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b9cbd531-0226-4bc9-a4de-9e1afa7ae6a2 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d" status: 404 len: 111 microversion: 2.1 time: 0.030400 Jul 31 20:06:35.853881 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 496/1000] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:35 2022] GET /compute/v2.1/servers/feed8b88-8df9-44a5-9520-0d723924fd1d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:37.011166 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d589b2ff-eea2-422c-a3a3-3ec7aeb4d1c1 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:37.012572 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d589b2ff-eea2-422c-a3a3-3ec7aeb4d1c1 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:37.018816 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:06:37.020796 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d589b2ff-eea2-422c-a3a3-3ec7aeb4d1c1 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:37.021610 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d589b2ff-eea2-422c-a3a3-3ec7aeb4d1c1 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:37.022829 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d589b2ff-eea2-422c-a3a3-3ec7aeb4d1c1 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:37.023478 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d589b2ff-eea2-422c-a3a3-3ec7aeb4d1c1 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:37.046084 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-d589b2ff-eea2-422c-a3a3-3ec7aeb4d1c1 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d589b2ff-eea2-422c-a3a3-3ec7aeb4d1c1 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 HTTP/1.1 Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:06:37.048008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:06:37.049887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:06:37.049887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:37.049887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:37.049887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:37.049887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:37.049887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:06:37.049887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:06:37.049887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:06:37.049887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:37.049887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:06:37.049887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:06:37.049887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': '176aa7ed-3c42-4749-852d-a397673e4e57'} Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:37.050950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:06:37.052522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:06:37.054767 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d589b2ff-eea2-422c-a3a3-3ec7aeb4d1c1 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 404 to user: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:37.055769 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d589b2ff-eea2-422c-a3a3-3ec7aeb4d1c1 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 404 len: 111 microversion: 2.1 time: 0.050323 Jul 31 20:06:37.056586 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 505/1001] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:06:37 2022] DELETE /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:37.071062 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3616cc3e-9d30-424f-8be3-df399ecfd588 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:37.071690 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3616cc3e-9d30-424f-8be3-df399ecfd588 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] [instance: 176aa7ed-3c42-4749-852d-a397673e4e57] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:37.079473 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3616cc3e-9d30-424f-8be3-df399ecfd588 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:37.079926 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3616cc3e-9d30-424f-8be3-df399ecfd588 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:37.080703 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3616cc3e-9d30-424f-8be3-df399ecfd588 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:37.081139 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3616cc3e-9d30-424f-8be3-df399ecfd588 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:37.097571 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-3616cc3e-9d30-424f-8be3-df399ecfd588 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] HTTP exception thrown: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3616cc3e-9d30-424f-8be3-df399ecfd588 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Request method failure captured: Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 HTTP/1.1 Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8rOoJAOK6IefC5vZENpguytZfxZu_FEu9--WhQaoiA2TP5YTUkbwJm4tHVkzspbNdTl2XtRjbP_bRXPmghE_xVQkGxpUyqaUJvR01rlgnbgFw3f1S5n-eJCgdCI38J2XBcPfPN4cQkAG7AEhTkXAUvGE9I1uy_sScMzIljgPJfO_E Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:06:37.099231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:06:37.100876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f435e60769a43deb3c15b351f97d62c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f435e60769a43deb3c15b351f97d62c"}]}] Jul 31 20:06:37.100876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:37.100876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 2f435e60769a43deb3c15b351f97d62c Jul 31 20:06:37.100876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-275490920 Jul 31 20:06:37.100876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:37.100876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:06:37.100876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:06:37.100876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 76b9c24c8dc94af8b2c8e44be8494e9b Jul 31 20:06:37.100876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-275490920-project Jul 31 20:06:37.100876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:06:37.100876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:06:37.100876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '176aa7ed-3c42-4749-852d-a397673e4e57'} Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:06:37.101757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. Jul 31 20:06:37.104894 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:06:37.106353 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3616cc3e-9d30-424f-8be3-df399ecfd588 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] Returning 404 to user: Instance 176aa7ed-3c42-4749-852d-a397673e4e57 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:06:37.106353 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3616cc3e-9d30-424f-8be3-df399ecfd588 tempest-AttachVolumeNegativeTest-275490920 tempest-AttachVolumeNegativeTest-275490920-project] 10.222.0.48 "GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57" status: 404 len: 111 microversion: 2.1 time: 0.039753 Jul 31 20:06:37.106353 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 497/1002] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:37 2022] GET /compute/v2.1/servers/176aa7ed-3c42-4749-852d-a397673e4e57 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:06:58.175407 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1444471371", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "networks": [{"uuid": "7dc04734-f8b6-4c5e-99f1-05a72adcd563"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:06:58.184111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=44 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:06:58.230896 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] validate_networks() for [('7dc04734-f8b6-4c5e-99f1-05a72adcd563', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:06:58.630206 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-906062532", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1052386514", "security_groups": [{"name": "tempest-secgroup-smoke-1065349258"}], "block_device_mapping_v2": [{"uuid": "f3243b91-e79a-48d9-af4e-18300ab99420", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4ede3dd9-1e02-435f-a555-c3b09c614bb8"}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:06:58.640793 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:06:58.641463 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:06:58.783210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:06:58.783691 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:06:58.784230 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:06:58.784755 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:06:58.785258 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:06:58.795153 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:58.795684 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:58.796642 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:58.797196 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:58.799764 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] validate_networks() for [('4ede3dd9-1e02-435f-a555-c3b09c614bb8', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:06:58.839045 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Getting quotas for project 74d67e6c2b804537a7e28c659a293501. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:06:58.845299 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Getting quotas for user db8b11bc570e4f8189c2fd375ef7093c and project 74d67e6c2b804537a7e28c659a293501. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:06:58.858603 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:06:58.861292 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:06:58.937917 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0a765a24-d0a1-45da-8369-3bfb7be18936 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767009 Jul 31 20:06:58.939398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 506/1003] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:06:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:06:58.950562 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-185f3f14-763b-40a2-84c2-2f6b6bd52852 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:58.952945 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-185f3f14-763b-40a2-84c2-2f6b6bd52852 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:59.061461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-185f3f14-763b-40a2-84c2-2f6b6bd52852 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:59.070093 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-185f3f14-763b-40a2-84c2-2f6b6bd52852 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1214 microversion: 2.1 time: 0.123763 Jul 31 20:06:59.072210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 507/1004] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:58 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:06:59.334946 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:06:59.336319 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:06:59.337552 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:06:59.338084 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:06:59.338865 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:06:59.353451 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:59.353981 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:59.355352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:06:59.357132 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:06:59.379687 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Getting quotas for project 15e426e0b2bd4bc29e7a8e222fcc8f7e. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:06:59.384110 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Getting quotas for user c6d7c6c7a3b5413c9c8d5c1e69d9db4c and project 15e426e0b2bd4bc29e7a8e222fcc8f7e. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:06:59.464846 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:06:59.471627 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f3243b91-e79a-48d9-af4e-18300ab99420',volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:06:59.669865 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-33874361-aa4b-4859-97b3-a3e3f95fe1a4 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.043377 Jul 31 20:06:59.670685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 498/1005] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:06:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 20:06:59.681710 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-879d4a63-e049-49a2-9cf4-902617a1e14d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:06:59.683361 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-879d4a63-e049-49a2-9cf4-902617a1e14d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:06:59.767050 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-879d4a63-e049-49a2-9cf4-902617a1e14d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:06:59.774568 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-879d4a63-e049-49a2-9cf4-902617a1e14d tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1094 microversion: 2.1 time: 0.096713 Jul 31 20:06:59.777296 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 508/1006] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:06:59 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:00.092554 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-86a1df08-091a-4901-87f0-14dc6a61bfaf tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:00.093520 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-86a1df08-091a-4901-87f0-14dc6a61bfaf tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:00.100192 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-86a1df08-091a-4901-87f0-14dc6a61bfaf tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:00.101866 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-86a1df08-091a-4901-87f0-14dc6a61bfaf tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:00.102633 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-86a1df08-091a-4901-87f0-14dc6a61bfaf tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:00.103074 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-86a1df08-091a-4901-87f0-14dc6a61bfaf tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:00.215223 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-86a1df08-091a-4901-87f0-14dc6a61bfaf tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:00.224478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-86a1df08-091a-4901-87f0-14dc6a61bfaf tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1266 microversion: 2.1 time: 0.136266 Jul 31 20:07:00.225403 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 499/1007] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:00 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:07:00.795684 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c41365a0-cf21-463b-9558-852432cf05fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:00.796083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c41365a0-cf21-463b-9558-852432cf05fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:00.803010 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c41365a0-cf21-463b-9558-852432cf05fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:00.803729 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c41365a0-cf21-463b-9558-852432cf05fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:00.804674 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c41365a0-cf21-463b-9558-852432cf05fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:00.805343 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c41365a0-cf21-463b-9558-852432cf05fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:00.908384 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c41365a0-cf21-463b-9558-852432cf05fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:00.917309 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c41365a0-cf21-463b-9558-852432cf05fe tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1192 microversion: 2.1 time: 0.125820 Jul 31 20:07:00.917890 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 509/1008] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:00 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1192 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:01.250123 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-75371371-7375-4bbc-9ea7-65fd42c3d29a tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:01.250665 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-75371371-7375-4bbc-9ea7-65fd42c3d29a tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:01.263517 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75371371-7375-4bbc-9ea7-65fd42c3d29a tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:01.263953 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75371371-7375-4bbc-9ea7-65fd42c3d29a tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:01.264728 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75371371-7375-4bbc-9ea7-65fd42c3d29a tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:01.265244 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75371371-7375-4bbc-9ea7-65fd42c3d29a tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:01.563257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-75371371-7375-4bbc-9ea7-65fd42c3d29a tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:01.572057 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-75371371-7375-4bbc-9ea7-65fd42c3d29a tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1314 microversion: 2.1 time: 0.327959 Jul 31 20:07:01.573125 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 500/1009] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:01 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:01.941450 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f818839-b455-454d-b70f-e4361abe1385 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:01.942127 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8f818839-b455-454d-b70f-e4361abe1385 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:01.949598 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f818839-b455-454d-b70f-e4361abe1385 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:01.950366 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f818839-b455-454d-b70f-e4361abe1385 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:01.951212 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f818839-b455-454d-b70f-e4361abe1385 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:01.951707 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f818839-b455-454d-b70f-e4361abe1385 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:02.086175 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8f818839-b455-454d-b70f-e4361abe1385 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:02.096270 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8f818839-b455-454d-b70f-e4361abe1385 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1210 microversion: 2.1 time: 0.159819 Jul 31 20:07:02.097844 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 510/1010] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:01 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1210 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:02.562173 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-88897718-7f69-460a-85a9-dc60a27c2e75 req-7601fcda-dc44-4733-a05b-b7c694cb1d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02c8dcd8-318d-43ba-93dc-1e91082f2289", "tag": "762719dc-bec3-43b1-860f-800e18636e1f"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:07:02.577765 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-88897718-7f69-460a-85a9-dc60a27c2e75 req-7601fcda-dc44-4733-a05b-b7c694cb1d29 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:02.578427 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-88897718-7f69-460a-85a9-dc60a27c2e75 req-7601fcda-dc44-4733-a05b-b7c694cb1d29 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:02.599030 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-965c9757-b85a-4e7d-aea2-307c9ef13e31 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:02.600141 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-965c9757-b85a-4e7d-aea2-307c9ef13e31 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:02.607104 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-88897718-7f69-460a-85a9-dc60a27c2e75 req-7601fcda-dc44-4733-a05b-b7c694cb1d29 service nova] Creating event network-changed:762719dc-bec3-43b1-860f-800e18636e1f for instance 02c8dcd8-318d-43ba-93dc-1e91082f2289 on hv-cinder-84984 Jul 31 20:07:02.612558 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-965c9757-b85a-4e7d-aea2-307c9ef13e31 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:02.613012 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-965c9757-b85a-4e7d-aea2-307c9ef13e31 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:02.614369 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-965c9757-b85a-4e7d-aea2-307c9ef13e31 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:02.614753 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-965c9757-b85a-4e7d-aea2-307c9ef13e31 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:02.616527 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-88897718-7f69-460a-85a9-dc60a27c2e75 req-7601fcda-dc44-4733-a05b-b7c694cb1d29 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061184 Jul 31 20:07:02.619183 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 501/1011] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:07:02.990101 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-965c9757-b85a-4e7d-aea2-307c9ef13e31 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:02.999923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-965c9757-b85a-4e7d-aea2-307c9ef13e31 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1314 microversion: 2.1 time: 0.405733 Jul 31 20:07:03.009283 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 511/1012] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:02 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:03.122225 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f741cda6-5764-4f91-b38e-4760ed78090e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:03.123496 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f741cda6-5764-4f91-b38e-4760ed78090e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:03.132112 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f741cda6-5764-4f91-b38e-4760ed78090e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:03.132787 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f741cda6-5764-4f91-b38e-4760ed78090e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:03.133775 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f741cda6-5764-4f91-b38e-4760ed78090e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:03.134423 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f741cda6-5764-4f91-b38e-4760ed78090e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:03.683883 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f741cda6-5764-4f91-b38e-4760ed78090e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:03.693803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f741cda6-5764-4f91-b38e-4760ed78090e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1266 microversion: 2.1 time: 0.579211 Jul 31 20:07:03.694781 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 502/1013] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:03 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1266 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:04.022164 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9042d279-140a-4f58-bf6a-b73cd765082f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:04.022839 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9042d279-140a-4f58-bf6a-b73cd765082f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:04.036726 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9042d279-140a-4f58-bf6a-b73cd765082f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:04.037875 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9042d279-140a-4f58-bf6a-b73cd765082f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:04.060633 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9042d279-140a-4f58-bf6a-b73cd765082f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:04.060633 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9042d279-140a-4f58-bf6a-b73cd765082f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:04.248652 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9042d279-140a-4f58-bf6a-b73cd765082f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:04.258897 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9042d279-140a-4f58-bf6a-b73cd765082f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1314 microversion: 2.1 time: 0.240355 Jul 31 20:07:04.260060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 512/1014] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:04 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:04.649126 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-1b54915f-f50c-4bbf-bfc3-e4ea850190e8 req-0473b106-ddcb-44b8-9b10-3347c39dd46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642ca76f-9999-4d11-82d6-52e16c8f6207", "tag": "56de90d4-e582-4bc6-9afd-0a7a09dd281e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:07:04.659974 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1b54915f-f50c-4bbf-bfc3-e4ea850190e8 req-0473b106-ddcb-44b8-9b10-3347c39dd46b service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:04.660419 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1b54915f-f50c-4bbf-bfc3-e4ea850190e8 req-0473b106-ddcb-44b8-9b10-3347c39dd46b service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:04.671408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-1b54915f-f50c-4bbf-bfc3-e4ea850190e8 req-0473b106-ddcb-44b8-9b10-3347c39dd46b service nova] Creating event network-changed:56de90d4-e582-4bc6-9afd-0a7a09dd281e for instance 642ca76f-9999-4d11-82d6-52e16c8f6207 on hv-cinder-84984 Jul 31 20:07:04.676180 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-1b54915f-f50c-4bbf-bfc3-e4ea850190e8 req-0473b106-ddcb-44b8-9b10-3347c39dd46b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031005 Jul 31 20:07:04.676756 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 503/1015] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:07:04.719188 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e90c6bfa-8cc0-409e-bf2e-daaa9b2774a0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:04.720110 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e90c6bfa-8cc0-409e-bf2e-daaa9b2774a0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:04.726281 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e90c6bfa-8cc0-409e-bf2e-daaa9b2774a0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:04.726805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e90c6bfa-8cc0-409e-bf2e-daaa9b2774a0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:04.727561 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e90c6bfa-8cc0-409e-bf2e-daaa9b2774a0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:04.727995 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e90c6bfa-8cc0-409e-bf2e-daaa9b2774a0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:04.935369 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e90c6bfa-8cc0-409e-bf2e-daaa9b2774a0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:04.943816 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e90c6bfa-8cc0-409e-bf2e-daaa9b2774a0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1266 microversion: 2.1 time: 0.228430 Jul 31 20:07:04.944921 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 513/1016] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:04 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:05.280413 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a6224719-d23c-4ad9-a2f4-5dec65180ed6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:05.281136 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a6224719-d23c-4ad9-a2f4-5dec65180ed6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:05.287670 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6224719-d23c-4ad9-a2f4-5dec65180ed6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:05.288537 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6224719-d23c-4ad9-a2f4-5dec65180ed6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:05.289837 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6224719-d23c-4ad9-a2f4-5dec65180ed6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:05.290416 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6224719-d23c-4ad9-a2f4-5dec65180ed6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:05.619713 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a6224719-d23c-4ad9-a2f4-5dec65180ed6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:05.630656 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a6224719-d23c-4ad9-a2f4-5dec65180ed6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1314 microversion: 2.1 time: 0.354267 Jul 31 20:07:05.631437 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 504/1017] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:05 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:05.965058 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-54517e93-ea64-4382-aca9-8e0a4756e464 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:05.965692 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-54517e93-ea64-4382-aca9-8e0a4756e464 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:05.972625 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54517e93-ea64-4382-aca9-8e0a4756e464 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:05.973067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54517e93-ea64-4382-aca9-8e0a4756e464 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:05.973869 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54517e93-ea64-4382-aca9-8e0a4756e464 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:05.974296 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54517e93-ea64-4382-aca9-8e0a4756e464 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:06.163817 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-54517e93-ea64-4382-aca9-8e0a4756e464 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:06.171676 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-54517e93-ea64-4382-aca9-8e0a4756e464 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1266 microversion: 2.1 time: 0.210516 Jul 31 20:07:06.172944 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 514/1018] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:05 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:07:06.651816 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2327b8dd-dd3d-46e2-9893-282d968ea0ac tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:06.652425 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2327b8dd-dd3d-46e2-9893-282d968ea0ac tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:06.659179 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2327b8dd-dd3d-46e2-9893-282d968ea0ac tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:06.659656 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2327b8dd-dd3d-46e2-9893-282d968ea0ac tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:06.660417 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2327b8dd-dd3d-46e2-9893-282d968ea0ac tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:06.660847 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2327b8dd-dd3d-46e2-9893-282d968ea0ac tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:06.809907 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2327b8dd-dd3d-46e2-9893-282d968ea0ac tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:06.818096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2327b8dd-dd3d-46e2-9893-282d968ea0ac tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1314 microversion: 2.1 time: 0.170119 Jul 31 20:07:06.818715 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 505/1019] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:06 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:07.194477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eabde1fb-0e8d-4159-9371-166f221e9faf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:07.195052 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eabde1fb-0e8d-4159-9371-166f221e9faf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:07.202030 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eabde1fb-0e8d-4159-9371-166f221e9faf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:07.202481 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eabde1fb-0e8d-4159-9371-166f221e9faf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:07.203251 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eabde1fb-0e8d-4159-9371-166f221e9faf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:07.203686 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eabde1fb-0e8d-4159-9371-166f221e9faf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:07.342460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eabde1fb-0e8d-4159-9371-166f221e9faf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:07.350633 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eabde1fb-0e8d-4159-9371-166f221e9faf tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1266 microversion: 2.1 time: 0.160271 Jul 31 20:07:07.351205 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 515/1020] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:07 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:07.840184 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ce2f1674-c41d-4c59-997f-763d71c38cda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:07.840806 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ce2f1674-c41d-4c59-997f-763d71c38cda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:07.847501 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce2f1674-c41d-4c59-997f-763d71c38cda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:07.847941 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce2f1674-c41d-4c59-997f-763d71c38cda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:07.848665 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce2f1674-c41d-4c59-997f-763d71c38cda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:07.849094 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce2f1674-c41d-4c59-997f-763d71c38cda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:07.990303 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ce2f1674-c41d-4c59-997f-763d71c38cda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:07.999762 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ce2f1674-c41d-4c59-997f-763d71c38cda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1314 microversion: 2.1 time: 0.163480 Jul 31 20:07:08.012905 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 506/1021] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:07 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:08.041057 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-89be7a43-f7de-4085-b3aa-78fe5ac40815 req-4072948e-151e-4f4a-90db-b578cfe09614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c8dcd8-318d-43ba-93dc-1e91082f2289", "name": "network-vif-plugged", "status": "completed", "tag": "762719dc-bec3-43b1-860f-800e18636e1f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:07:08.054561 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-89be7a43-f7de-4085-b3aa-78fe5ac40815 req-4072948e-151e-4f4a-90db-b578cfe09614 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:08.055008 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-89be7a43-f7de-4085-b3aa-78fe5ac40815 req-4072948e-151e-4f4a-90db-b578cfe09614 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:08.066341 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-89be7a43-f7de-4085-b3aa-78fe5ac40815 req-4072948e-151e-4f4a-90db-b578cfe09614 service nova] Creating event network-vif-plugged:762719dc-bec3-43b1-860f-800e18636e1f for instance 02c8dcd8-318d-43ba-93dc-1e91082f2289 on hv-cinder-84984 Jul 31 20:07:08.071250 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-89be7a43-f7de-4085-b3aa-78fe5ac40815 req-4072948e-151e-4f4a-90db-b578cfe09614 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039398 Jul 31 20:07:08.071828 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 516/1022] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:07:08.377102 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4057ad19-4111-42c3-a24c-126d63ffc6e9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:08.377760 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4057ad19-4111-42c3-a24c-126d63ffc6e9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:08.384291 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4057ad19-4111-42c3-a24c-126d63ffc6e9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:08.384761 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4057ad19-4111-42c3-a24c-126d63ffc6e9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:08.385537 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4057ad19-4111-42c3-a24c-126d63ffc6e9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:08.385969 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4057ad19-4111-42c3-a24c-126d63ffc6e9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:08.531478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4057ad19-4111-42c3-a24c-126d63ffc6e9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:08.538945 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4057ad19-4111-42c3-a24c-126d63ffc6e9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1266 microversion: 2.1 time: 0.166191 Jul 31 20:07:08.539715 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 507/1023] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:08 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:09.017796 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:09.021967 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-98c852aa-ce73-45fa-8b15-7e3c9cfa731b tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:09.022687 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-98c852aa-ce73-45fa-8b15-7e3c9cfa731b tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:09.029456 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98c852aa-ce73-45fa-8b15-7e3c9cfa731b tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:09.029907 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98c852aa-ce73-45fa-8b15-7e3c9cfa731b tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:09.030716 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98c852aa-ce73-45fa-8b15-7e3c9cfa731b tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:09.031111 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98c852aa-ce73-45fa-8b15-7e3c9cfa731b tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:09.166227 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-98c852aa-ce73-45fa-8b15-7e3c9cfa731b tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:09.175156 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-98c852aa-ce73-45fa-8b15-7e3c9cfa731b tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1314 microversion: 2.1 time: 0.159050 Jul 31 20:07:09.175734 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 517/1024] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:09 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:09.560203 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-796005b5-6cfe-4fe4-b453-897714ab79e1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:09.560922 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-796005b5-6cfe-4fe4-b453-897714ab79e1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:09.565493 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:09.566103 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:09.569681 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-796005b5-6cfe-4fe4-b453-897714ab79e1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:09.570117 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-796005b5-6cfe-4fe4-b453-897714ab79e1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:09.571055 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-796005b5-6cfe-4fe4-b453-897714ab79e1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:09.572345 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-796005b5-6cfe-4fe4-b453-897714ab79e1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:09.709616 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-796005b5-6cfe-4fe4-b453-897714ab79e1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:09.717595 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-796005b5-6cfe-4fe4-b453-897714ab79e1 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1266 microversion: 2.1 time: 0.161406 Jul 31 20:07:09.718169 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 508/1025] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:09 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:10.198079 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5c58f74e-203f-471f-963a-f528a254cdb6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:10.198739 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5c58f74e-203f-471f-963a-f528a254cdb6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:10.205035 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=10 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:10.209233 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c58f74e-203f-471f-963a-f528a254cdb6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:10.209682 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c58f74e-203f-471f-963a-f528a254cdb6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:10.210452 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c58f74e-203f-471f-963a-f528a254cdb6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:10.210917 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c58f74e-203f-471f-963a-f528a254cdb6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:10.358157 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5c58f74e-203f-471f-963a-f528a254cdb6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:10.365606 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5c58f74e-203f-471f-963a-f528a254cdb6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1314 microversion: 2.1 time: 0.171513 Jul 31 20:07:10.366193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 518/1026] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:10 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:10.739010 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-af6c2399-0676-4daa-ad0c-07cd95604d8e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:10.739551 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-af6c2399-0676-4daa-ad0c-07cd95604d8e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:10.746736 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af6c2399-0676-4daa-ad0c-07cd95604d8e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:10.747174 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af6c2399-0676-4daa-ad0c-07cd95604d8e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:10.747923 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af6c2399-0676-4daa-ad0c-07cd95604d8e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:10.748345 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af6c2399-0676-4daa-ad0c-07cd95604d8e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:10.932059 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-af6c2399-0676-4daa-ad0c-07cd95604d8e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:10.939889 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-af6c2399-0676-4daa-ad0c-07cd95604d8e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1266 microversion: 2.1 time: 0.204617 Jul 31 20:07:10.940431 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 509/1027] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:10 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:11.386750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b25119bb-9087-4e36-beee-058b37ecd887 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:11.387427 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b25119bb-9087-4e36-beee-058b37ecd887 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:11.394530 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b25119bb-9087-4e36-beee-058b37ecd887 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:11.394961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b25119bb-9087-4e36-beee-058b37ecd887 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:11.395718 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b25119bb-9087-4e36-beee-058b37ecd887 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:11.396145 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b25119bb-9087-4e36-beee-058b37ecd887 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:11.593876 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b25119bb-9087-4e36-beee-058b37ecd887 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:11.601827 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b25119bb-9087-4e36-beee-058b37ecd887 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1497 microversion: 2.1 time: 0.219352 Jul 31 20:07:11.602462 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 519/1028] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:11 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1497 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:11.960672 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-861dfd2a-5bb8-4587-ab46-78a7ee8af2c7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:11.961943 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-861dfd2a-5bb8-4587-ab46-78a7ee8af2c7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:11.970888 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-861dfd2a-5bb8-4587-ab46-78a7ee8af2c7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:11.971338 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-861dfd2a-5bb8-4587-ab46-78a7ee8af2c7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:11.972114 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-861dfd2a-5bb8-4587-ab46-78a7ee8af2c7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:11.972544 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-861dfd2a-5bb8-4587-ab46-78a7ee8af2c7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:12.113607 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-861dfd2a-5bb8-4587-ab46-78a7ee8af2c7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:12.121498 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-861dfd2a-5bb8-4587-ab46-78a7ee8af2c7 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1266 microversion: 2.1 time: 0.165332 Jul 31 20:07:12.122064 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 510/1029] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:11 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:12.235734 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-71790c2f-595a-467a-834a-102a22c0a4f6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:12.236595 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-71790c2f-595a-467a-834a-102a22c0a4f6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:12.243110 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71790c2f-595a-467a-834a-102a22c0a4f6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:12.243559 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71790c2f-595a-467a-834a-102a22c0a4f6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:12.244339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71790c2f-595a-467a-834a-102a22c0a4f6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:12.244772 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71790c2f-595a-467a-834a-102a22c0a4f6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:12.270421 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-71790c2f-595a-467a-834a-102a22c0a4f6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:07:12.349425 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-71790c2f-595a-467a-834a-102a22c0a4f6 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "DELETE /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 204 len: 0 microversion: 2.1 time: 0.117251 Jul 31 20:07:12.350476 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 520/1030] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:07:12 2022] DELETE /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:07:12.358693 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2797b2a5-af29-4428-9521-ba5a804b4aef tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:12.359339 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2797b2a5-af29-4428-9521-ba5a804b4aef tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:12.366488 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2797b2a5-af29-4428-9521-ba5a804b4aef tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:12.367044 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2797b2a5-af29-4428-9521-ba5a804b4aef tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:12.368176 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2797b2a5-af29-4428-9521-ba5a804b4aef tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:12.368627 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2797b2a5-af29-4428-9521-ba5a804b4aef tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:12.515062 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2797b2a5-af29-4428-9521-ba5a804b4aef tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:12.522771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2797b2a5-af29-4428-9521-ba5a804b4aef tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1503 microversion: 2.1 time: 0.167888 Jul 31 20:07:12.523344 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 511/1031] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:12 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:07:12.667181 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e470af43-aa8e-48eb-a42d-5fe051820daf tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:12.669560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e470af43-aa8e-48eb-a42d-5fe051820daf tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:12.678698 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e470af43-aa8e-48eb-a42d-5fe051820daf tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:12.678698 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e470af43-aa8e-48eb-a42d-5fe051820daf tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:12.678698 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e470af43-aa8e-48eb-a42d-5fe051820daf tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:12.678698 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e470af43-aa8e-48eb-a42d-5fe051820daf tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:12.707683 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e470af43-aa8e-48eb-a42d-5fe051820daf tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044960 Jul 31 20:07:12.708438 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 521/1032] 10.222.0.48 () {60 vars in 1343 bytes} [Sun Jul 31 20:07:12 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:12.788126 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-460128ce-f8c0-4fbe-a948-0d51ac5b9bf2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:12.788710 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-460128ce-f8c0-4fbe-a948-0d51ac5b9bf2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:12.796007 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-460128ce-f8c0-4fbe-a948-0d51ac5b9bf2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:12.796447 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-460128ce-f8c0-4fbe-a948-0d51ac5b9bf2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:12.797250 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-460128ce-f8c0-4fbe-a948-0d51ac5b9bf2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:12.797680 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-460128ce-f8c0-4fbe-a948-0d51ac5b9bf2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:12.822741 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-460128ce-f8c0-4fbe-a948-0d51ac5b9bf2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:07:12.904927 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-460128ce-f8c0-4fbe-a948-0d51ac5b9bf2 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "DELETE /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 204 len: 0 microversion: 2.20 time: 0.120480 Jul 31 20:07:12.905533 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 512/1033] 10.222.0.48 () {60 vars in 1280 bytes} [Sun Jul 31 20:07:12 2022] DELETE /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 20:07:12.913637 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bf063a74-b516-4fa0-b044-1e8c732e5fcd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:12.914234 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bf063a74-b516-4fa0-b044-1e8c732e5fcd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:12.920396 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf063a74-b516-4fa0-b044-1e8c732e5fcd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:12.920837 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf063a74-b516-4fa0-b044-1e8c732e5fcd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:12.924583 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf063a74-b516-4fa0-b044-1e8c732e5fcd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:12.924583 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf063a74-b516-4fa0-b044-1e8c732e5fcd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:13.068787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bf063a74-b516-4fa0-b044-1e8c732e5fcd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:13.077487 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bf063a74-b516-4fa0-b044-1e8c732e5fcd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:13.078968 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bf063a74-b516-4fa0-b044-1e8c732e5fcd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:13.080120 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bf063a74-b516-4fa0-b044-1e8c732e5fcd tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.170310 Jul 31 20:07:13.080667 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 522/1034] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:07:12 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:07:13.143125 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-20e1c8b5-861d-41cd-8531-670ac94810ae tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:13.143824 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-20e1c8b5-861d-41cd-8531-670ac94810ae tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:13.150950 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20e1c8b5-861d-41cd-8531-670ac94810ae tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:13.151392 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20e1c8b5-861d-41cd-8531-670ac94810ae tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:13.152163 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20e1c8b5-861d-41cd-8531-670ac94810ae tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:13.152595 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20e1c8b5-861d-41cd-8531-670ac94810ae tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:13.290921 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-20e1c8b5-861d-41cd-8531-670ac94810ae tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:13.299190 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-20e1c8b5-861d-41cd-8531-670ac94810ae tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1266 microversion: 2.1 time: 0.160554 Jul 31 20:07:13.299858 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 513/1035] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:13 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:13.546764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e1575550-8947-40df-b59b-cbccef654da7 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:13.547418 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e1575550-8947-40df-b59b-cbccef654da7 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:13.555578 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1575550-8947-40df-b59b-cbccef654da7 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:13.556072 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1575550-8947-40df-b59b-cbccef654da7 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:13.556850 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1575550-8947-40df-b59b-cbccef654da7 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:13.557315 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1575550-8947-40df-b59b-cbccef654da7 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:13.714184 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e1575550-8947-40df-b59b-cbccef654da7 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:13.722022 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e1575550-8947-40df-b59b-cbccef654da7 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1503 microversion: 2.1 time: 0.181769 Jul 31 20:07:13.722581 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 523/1036] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:13 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:14.103173 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a6c86d82-87c5-426d-9ac4-2d1e6142c599 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:14.103784 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a6c86d82-87c5-426d-9ac4-2d1e6142c599 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:14.110054 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6c86d82-87c5-426d-9ac4-2d1e6142c599 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:14.110729 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6c86d82-87c5-426d-9ac4-2d1e6142c599 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:14.111501 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6c86d82-87c5-426d-9ac4-2d1e6142c599 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:14.111935 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6c86d82-87c5-426d-9ac4-2d1e6142c599 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:14.245502 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a6c86d82-87c5-426d-9ac4-2d1e6142c599 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:14.249982 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:14.255789 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a6c86d82-87c5-426d-9ac4-2d1e6142c599 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:14.257515 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a6c86d82-87c5-426d-9ac4-2d1e6142c599 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:14.258971 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a6c86d82-87c5-426d-9ac4-2d1e6142c599 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.159914 Jul 31 20:07:14.259573 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 514/1037] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:07:14 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:07:14.320234 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bca6afbb-744c-4cb9-b9bc-317565b27e04 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:14.320901 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bca6afbb-744c-4cb9-b9bc-317565b27e04 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:14.327190 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bca6afbb-744c-4cb9-b9bc-317565b27e04 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:14.327670 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bca6afbb-744c-4cb9-b9bc-317565b27e04 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:14.328425 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bca6afbb-744c-4cb9-b9bc-317565b27e04 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:14.328851 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bca6afbb-744c-4cb9-b9bc-317565b27e04 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:14.333050 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:14.467838 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bca6afbb-744c-4cb9-b9bc-317565b27e04 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:14.476240 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bca6afbb-744c-4cb9-b9bc-317565b27e04 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1266 microversion: 2.1 time: 0.159875 Jul 31 20:07:14.476830 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 524/1038] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:14 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:14.743821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4a32b9de-7fcf-4fd6-b3bf-c19a06459a02 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:14.744531 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4a32b9de-7fcf-4fd6-b3bf-c19a06459a02 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:14.752310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a32b9de-7fcf-4fd6-b3bf-c19a06459a02 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:14.752823 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a32b9de-7fcf-4fd6-b3bf-c19a06459a02 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:14.753720 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a32b9de-7fcf-4fd6-b3bf-c19a06459a02 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:14.754210 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a32b9de-7fcf-4fd6-b3bf-c19a06459a02 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:14.898956 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4a32b9de-7fcf-4fd6-b3bf-c19a06459a02 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:14.908272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4a32b9de-7fcf-4fd6-b3bf-c19a06459a02 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1503 microversion: 2.1 time: 0.168771 Jul 31 20:07:14.908946 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 515/1039] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:14 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:15.282948 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e585f5e9-f359-4d82-9978-9b9674a60d71 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:15.283547 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e585f5e9-f359-4d82-9978-9b9674a60d71 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:15.290342 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e585f5e9-f359-4d82-9978-9b9674a60d71 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:15.290787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e585f5e9-f359-4d82-9978-9b9674a60d71 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:15.291518 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e585f5e9-f359-4d82-9978-9b9674a60d71 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:15.292736 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e585f5e9-f359-4d82-9978-9b9674a60d71 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:15.478639 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e585f5e9-f359-4d82-9978-9b9674a60d71 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:15.487068 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e585f5e9-f359-4d82-9978-9b9674a60d71 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:15.488563 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e585f5e9-f359-4d82-9978-9b9674a60d71 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:15.491553 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e585f5e9-f359-4d82-9978-9b9674a60d71 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.211032 Jul 31 20:07:15.505175 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 525/1040] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:07:15 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:07:15.505774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8f3454bc-3806-44a9-b329-b6df419fc35b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:15.505774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8f3454bc-3806-44a9-b329-b6df419fc35b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:15.505774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8f3454bc-3806-44a9-b329-b6df419fc35b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:15.505774 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8f3454bc-3806-44a9-b329-b6df419fc35b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:15.506495 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8f3454bc-3806-44a9-b329-b6df419fc35b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:15.506757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8f3454bc-3806-44a9-b329-b6df419fc35b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:15.838757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8f3454bc-3806-44a9-b329-b6df419fc35b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:15.847265 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8f3454bc-3806-44a9-b329-b6df419fc35b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1266 microversion: 2.1 time: 0.354717 Jul 31 20:07:15.848066 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 516/1041] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:15 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1266 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:15.935382 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ab015eb4-9abb-4e15-aeb2-5c6aa83b6669 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:15.935382 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ab015eb4-9abb-4e15-aeb2-5c6aa83b6669 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:15.946673 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab015eb4-9abb-4e15-aeb2-5c6aa83b6669 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:15.947131 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab015eb4-9abb-4e15-aeb2-5c6aa83b6669 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:15.947899 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab015eb4-9abb-4e15-aeb2-5c6aa83b6669 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:15.948307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab015eb4-9abb-4e15-aeb2-5c6aa83b6669 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:16.138737 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-04010be7-cb82-4279-9490-12badea5c1de req-f7f177f9-72eb-41f4-b425-986456ecdd91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "642ca76f-9999-4d11-82d6-52e16c8f6207", "name": "network-vif-plugged", "status": "completed", "tag": "56de90d4-e582-4bc6-9afd-0a7a09dd281e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:07:16.151661 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-04010be7-cb82-4279-9490-12badea5c1de req-f7f177f9-72eb-41f4-b425-986456ecdd91 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:16.152384 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-04010be7-cb82-4279-9490-12badea5c1de req-f7f177f9-72eb-41f4-b425-986456ecdd91 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:16.171861 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-04010be7-cb82-4279-9490-12badea5c1de req-f7f177f9-72eb-41f4-b425-986456ecdd91 service nova] Creating event network-vif-plugged:56de90d4-e582-4bc6-9afd-0a7a09dd281e for instance 642ca76f-9999-4d11-82d6-52e16c8f6207 on hv-cinder-84984 Jul 31 20:07:16.179383 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-04010be7-cb82-4279-9490-12badea5c1de req-f7f177f9-72eb-41f4-b425-986456ecdd91 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043990 Jul 31 20:07:16.181382 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 517/1042] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:07:16.447537 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ab015eb4-9abb-4e15-aeb2-5c6aa83b6669 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:16.456810 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ab015eb4-9abb-4e15-aeb2-5c6aa83b6669 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1503 microversion: 2.1 time: 0.528497 Jul 31 20:07:16.457728 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 526/1043] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:15 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1503 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:07:16.519089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f9248ac5-8991-42cd-889a-9d74917f8888 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:16.519862 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f9248ac5-8991-42cd-889a-9d74917f8888 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:16.529475 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9248ac5-8991-42cd-889a-9d74917f8888 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:16.530280 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9248ac5-8991-42cd-889a-9d74917f8888 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:16.531231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9248ac5-8991-42cd-889a-9d74917f8888 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:16.531832 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9248ac5-8991-42cd-889a-9d74917f8888 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:16.868881 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e4d9d28e-ee4d-4b6f-9bab-ecb4d8e2c95b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:16.869784 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e4d9d28e-ee4d-4b6f-9bab-ecb4d8e2c95b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:16.876792 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f9248ac5-8991-42cd-889a-9d74917f8888 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:16.891858 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f9248ac5-8991-42cd-889a-9d74917f8888 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:16.894192 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4d9d28e-ee4d-4b6f-9bab-ecb4d8e2c95b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:16.894996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4d9d28e-ee4d-4b6f-9bab-ecb4d8e2c95b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:16.895794 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4d9d28e-ee4d-4b6f-9bab-ecb4d8e2c95b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:16.896225 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4d9d28e-ee4d-4b6f-9bab-ecb4d8e2c95b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:16.897276 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f9248ac5-8991-42cd-889a-9d74917f8888 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:16.898483 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f9248ac5-8991-42cd-889a-9d74917f8888 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1724 microversion: 2.20 time: 0.385100 Jul 31 20:07:16.902425 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 518/1044] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:07:16 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1724 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:07:16.917069 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-74bb133b-e99b-4e56-9a70-73147ba101c1 req-3dcc4984-9e9a-45ba-b1b6-1136f5776c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c8dcd8-318d-43ba-93dc-1e91082f2289", "name": "network-vif-deleted", "tag": "762719dc-bec3-43b1-860f-800e18636e1f"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:07:16.932936 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-74bb133b-e99b-4e56-9a70-73147ba101c1 req-3dcc4984-9e9a-45ba-b1b6-1136f5776c16 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:16.934383 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-74bb133b-e99b-4e56-9a70-73147ba101c1 req-3dcc4984-9e9a-45ba-b1b6-1136f5776c16 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:16.953422 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-74bb133b-e99b-4e56-9a70-73147ba101c1 req-3dcc4984-9e9a-45ba-b1b6-1136f5776c16 service nova] Creating event network-vif-deleted:762719dc-bec3-43b1-860f-800e18636e1f for instance 02c8dcd8-318d-43ba-93dc-1e91082f2289 on hv-cinder-84984 Jul 31 20:07:16.959619 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-74bb133b-e99b-4e56-9a70-73147ba101c1 req-3dcc4984-9e9a-45ba-b1b6-1136f5776c16 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055937 Jul 31 20:07:16.960409 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 519/1045] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:07:17.161762 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e4d9d28e-ee4d-4b6f-9bab-ecb4d8e2c95b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:17.178921 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e4d9d28e-ee4d-4b6f-9bab-ecb4d8e2c95b tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1266 microversion: 2.1 time: 0.314731 Jul 31 20:07:17.183383 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 527/1046] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:16 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:17.480278 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-175d58c2-3141-4f0c-b03e-79fa375e1c94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:17.481455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-175d58c2-3141-4f0c-b03e-79fa375e1c94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:17.490414 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-175d58c2-3141-4f0c-b03e-79fa375e1c94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:17.491193 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-175d58c2-3141-4f0c-b03e-79fa375e1c94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:17.492229 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-175d58c2-3141-4f0c-b03e-79fa375e1c94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:17.492849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-175d58c2-3141-4f0c-b03e-79fa375e1c94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:17.597499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-175d58c2-3141-4f0c-b03e-79fa375e1c94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:17.609054 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-175d58c2-3141-4f0c-b03e-79fa375e1c94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1299 microversion: 2.1 time: 0.134522 Jul 31 20:07:17.610299 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 520/1047] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:17 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:17.926263 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8a8364b7-764c-42ba-9654-0e564d785259 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:17.926875 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8a8364b7-764c-42ba-9654-0e564d785259 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:17.933693 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a8364b7-764c-42ba-9654-0e564d785259 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:17.934145 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a8364b7-764c-42ba-9654-0e564d785259 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:17.937382 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a8364b7-764c-42ba-9654-0e564d785259 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:17.937382 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a8364b7-764c-42ba-9654-0e564d785259 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:17.972573 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a8364b7-764c-42ba-9654-0e564d785259 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:17.973211 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a8364b7-764c-42ba-9654-0e564d785259 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:17.973562 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-8a8364b7-764c-42ba-9654-0e564d785259 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lazy-loading 'fault' on Instance uuid 86192351-1ad0-4d52-8496-e85d6e5381dd {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:07:18.017789 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a8364b7-764c-42ba-9654-0e564d785259 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:18.027116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a8364b7-764c-42ba-9654-0e564d785259 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:18.028622 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a8364b7-764c-42ba-9654-0e564d785259 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008286f78ee44232bf411bd695f0c0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed33078067c4aa3b0e1d1bf79fd379d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:18.030023 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8a8364b7-764c-42ba-9654-0e564d785259 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 200 len: 1372 microversion: 2.20 time: 0.107869 Jul 31 20:07:18.030561 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 528/1048] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:07:17 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 20:07:18.204169 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-40cce1fa-00d8-42f0-94c7-301509b165cc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:18.204779 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-40cce1fa-00d8-42f0-94c7-301509b165cc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:18.211467 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-40cce1fa-00d8-42f0-94c7-301509b165cc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:18.211910 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-40cce1fa-00d8-42f0-94c7-301509b165cc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:18.212678 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-40cce1fa-00d8-42f0-94c7-301509b165cc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:18.213120 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-40cce1fa-00d8-42f0-94c7-301509b165cc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:18.415312 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-40cce1fa-00d8-42f0-94c7-301509b165cc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:18.425586 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-40cce1fa-00d8-42f0-94c7-301509b165cc tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1452 microversion: 2.1 time: 0.225148 Jul 31 20:07:18.446876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 521/1049] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:18 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1452 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:18.459190 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-77ec064e-0051-41ba-a1a2-33d246191372 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:18.460581 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-77ec064e-0051-41ba-a1a2-33d246191372 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:18.479358 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77ec064e-0051-41ba-a1a2-33d246191372 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:18.479862 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77ec064e-0051-41ba-a1a2-33d246191372 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:18.487734 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77ec064e-0051-41ba-a1a2-33d246191372 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:18.488261 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77ec064e-0051-41ba-a1a2-33d246191372 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:18.633493 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b0c68c59-223e-4120-852e-e759d39f00cb tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:18.634117 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b0c68c59-223e-4120-852e-e759d39f00cb tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:18.642579 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0c68c59-223e-4120-852e-e759d39f00cb tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:18.642928 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0c68c59-223e-4120-852e-e759d39f00cb tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:18.644234 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0c68c59-223e-4120-852e-e759d39f00cb tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:18.644551 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0c68c59-223e-4120-852e-e759d39f00cb tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:18.646097 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-77ec064e-0051-41ba-a1a2-33d246191372 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:18.659461 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-77ec064e-0051-41ba-a1a2-33d246191372 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1452 microversion: 2.1 time: 0.207914 Jul 31 20:07:18.661193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 529/1050] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:18 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:18.686501 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0c68c59-223e-4120-852e-e759d39f00cb tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:18.687230 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0c68c59-223e-4120-852e-e759d39f00cb tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:18.687839 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-b0c68c59-223e-4120-852e-e759d39f00cb tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lazy-loading 'fault' on Instance uuid 02c8dcd8-318d-43ba-93dc-1e91082f2289 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:07:18.741184 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b0c68c59-223e-4120-852e-e759d39f00cb tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:18.751288 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b0c68c59-223e-4120-852e-e759d39f00cb tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 200 len: 1304 microversion: 2.1 time: 0.123107 Jul 31 20:07:18.752415 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 522/1051] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:18 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:18.992265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-03293705-00af-4c6e-ac32-c569d5f2580e req-9fd7cd51-5aae-4d5c-9920-85dd8fba7456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86192351-1ad0-4d52-8496-e85d6e5381dd", "name": "network-vif-deleted", "tag": "dc71e4bb-0c50-46be-9265-95e6a82b855e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:07:19.005885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-03293705-00af-4c6e-ac32-c569d5f2580e req-9fd7cd51-5aae-4d5c-9920-85dd8fba7456 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:19.006412 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-03293705-00af-4c6e-ac32-c569d5f2580e req-9fd7cd51-5aae-4d5c-9920-85dd8fba7456 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:19.019719 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-03293705-00af-4c6e-ac32-c569d5f2580e req-9fd7cd51-5aae-4d5c-9920-85dd8fba7456 service nova] Creating event network-vif-deleted:dc71e4bb-0c50-46be-9265-95e6a82b855e for instance 86192351-1ad0-4d52-8496-e85d6e5381dd on hv-cinder-84984 Jul 31 20:07:19.025458 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-03293705-00af-4c6e-ac32-c569d5f2580e req-9fd7cd51-5aae-4d5c-9920-85dd8fba7456 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036678 Jul 31 20:07:19.026193 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 530/1052] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:07:19.054217 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-476e8670-f3e5-4352-aa9d-58e11e022e90 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:19.055209 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-476e8670-f3e5-4352-aa9d-58e11e022e90 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:19.063131 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-476e8670-f3e5-4352-aa9d-58e11e022e90 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:19.063976 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-476e8670-f3e5-4352-aa9d-58e11e022e90 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:19.064979 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-476e8670-f3e5-4352-aa9d-58e11e022e90 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:19.065734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-476e8670-f3e5-4352-aa9d-58e11e022e90 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:19.087508 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-476e8670-f3e5-4352-aa9d-58e11e022e90 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] HTTP exception thrown: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-476e8670-f3e5-4352-aa9d-58e11e022e90 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Request method failure captured: Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd HTTP/1.1 Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8oAgPkCXFSCXzAwWcomGYGgRCZSqD5PbiKFhgC_8YXoyG3htprDr9Z9Yaub9xmSevREKTKJLFi7HY8G_jurb8fuiDJI53AJfeqZGpKdCviNEzIplzhE1X7OoiIbUzZ2zxBxTC25E0JpZlxAIQxKfLS4RlfGAzdjv5rTbDlbpM6cYc Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: aed33078067c4aa3b0e1d1bf79fd379d Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:07:19.090162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:07:19.092000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aed33078067c4aa3b0e1d1bf79fd379d"}]}] Jul 31 20:07:19.092000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:19.092000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: aed33078067c4aa3b0e1d1bf79fd379d Jul 31 20:07:19.092000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:19.092000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeShelveTestJSON-1481706984-project Jul 31 20:07:19.092000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:07:19.092000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:07:19.092000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 008286f78ee44232bf411bd695f0c0ed Jul 31 20:07:19.092000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481706984-project Jul 31 20:07:19.092000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:07:19.092000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:19.092000 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '86192351-1ad0-4d52-8496-e85d6e5381dd'} Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:07:19.092751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:19.094085 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:19.095228 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-476e8670-f3e5-4352-aa9d-58e11e022e90 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Returning 404 to user: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:07:19.095228 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-476e8670-f3e5-4352-aa9d-58e11e022e90 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 404 len: 111 microversion: 2.20 time: 0.041540 Jul 31 20:07:19.095228 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 523/1053] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:07:19 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 20:07:19.101433 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e8d70c83-bb9c-4b04-9524-a1570676b461 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '.version_select at 0x7ffa246e1af0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:19.122726 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e8d70c83-bb9c-4b04-9524-a1570676b461 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122594328" status: 204 len: 0 microversion: 2.20 time: 0.025624 Jul 31 20:07:19.123311 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 531/1054] 10.222.0.48 () {60 vars in 1262 bytes} [Sun Jul 31 20:07:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122594328 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 20:07:19.775958 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-13a7ab29-a9b1-44f2-b7d7-869e0417d89f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:19.777176 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-13a7ab29-a9b1-44f2-b7d7-869e0417d89f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: 02c8dcd8-318d-43ba-93dc-1e91082f2289] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:19.783800 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-13a7ab29-a9b1-44f2-b7d7-869e0417d89f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:19.784246 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-13a7ab29-a9b1-44f2-b7d7-869e0417d89f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:19.785025 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-13a7ab29-a9b1-44f2-b7d7-869e0417d89f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:19.785485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-13a7ab29-a9b1-44f2-b7d7-869e0417d89f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:19.799902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-13a7ab29-a9b1-44f2-b7d7-869e0417d89f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] HTTP exception thrown: Instance 02c8dcd8-318d-43ba-93dc-1e91082f2289 could not be found. Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-13a7ab29-a9b1-44f2-b7d7-869e0417d89f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Request method failure captured: Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 HTTP/1.1 Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5uDeC0M7Zkw2GKjFbmqrH4zgij7f0-TDT2fFrrHd_PufAZG6bN7gos8Dd51AvuzcnJWXgbita03QCq4_egpJkL9Nz4ke6jtK2fhJGRTskCFpQJyvKZhLUjjF1Ig1CzlcDPRP-l8kgcbakPB1pzqGhcX0PIDvBzxet3ROozrid3s09GM Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 74d67e6c2b804537a7e28c659a293501 Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesActionsTest-1757083405 Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:07:19.801448 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:07:19.803077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74d67e6c2b804537a7e28c659a293501"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74d67e6c2b804537a7e28c659a293501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_74d67e6c2b804537a7e28c659a293501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/74d67e6c2b804537a7e28c659a293501"}]}] Jul 31 20:07:19.803077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesActionsTest-1757083405 Jul 31 20:07:19.803077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 74d67e6c2b804537a7e28c659a293501 Jul 31 20:07:19.803077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesActionsTest-1757083405 Jul 31 20:07:19.803077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesActionsTest-1757083405-project Jul 31 20:07:19.803077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:07:19.803077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:07:19.803077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: db8b11bc570e4f8189c2fd375ef7093c Jul 31 20:07:19.803077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesActionsTest-1757083405-project Jul 31 20:07:19.803077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:07:19.803077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance 02c8dcd8-318d-43ba-93dc-1e91082f2289 could not be found. Jul 31 20:07:19.803077 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '02c8dcd8-318d-43ba-93dc-1e91082f2289'} Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02c8dcd8-318d-43ba-93dc-1e91082f2289 could not be found. Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:07:19.803965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02c8dcd8-318d-43ba-93dc-1e91082f2289 could not be found. Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02c8dcd8-318d-43ba-93dc-1e91082f2289 could not be found. Jul 31 20:07:19.805538 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:19.806840 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-13a7ab29-a9b1-44f2-b7d7-869e0417d89f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Returning 404 to user: Instance 02c8dcd8-318d-43ba-93dc-1e91082f2289 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:07:19.806840 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-13a7ab29-a9b1-44f2-b7d7-869e0417d89f tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289" status: 404 len: 111 microversion: 2.1 time: 0.031388 Jul 31 20:07:19.806840 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 524/1055] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:19 2022] GET /compute/v2.1/servers/02c8dcd8-318d-43ba-93dc-1e91082f2289 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:07:19.924558 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1814048791", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "networks": [{"uuid": "7dc04734-f8b6-4c5e-99f1-05a72adcd563"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:07:19.984437 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] validate_networks() for [('7dc04734-f8b6-4c5e-99f1-05a72adcd563', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:07:20.349653 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:07:20.350275 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:07:20.350566 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:07:20.350975 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:07:20.351382 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:07:20.367709 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:20.368182 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:20.368974 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:20.369432 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:20.388265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Getting quotas for project 74d67e6c2b804537a7e28c659a293501. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:07:20.392202 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Getting quotas for user db8b11bc570e4f8189c2fd375ef7093c and project 74d67e6c2b804537a7e28c659a293501. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:07:20.403562 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:07:20.405996 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:07:20.450406 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ff87d8c1-8fe7-4088-8259-c7e93ba5e1e5 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533918 Jul 31 20:07:20.451399 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 532/1056] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:07:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:07:20.462217 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f94be49e-5348-4443-9b0d-514aa4a88f2e tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:20.462790 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f94be49e-5348-4443-9b0d-514aa4a88f2e tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:20.518547 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f94be49e-5348-4443-9b0d-514aa4a88f2e tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:20.525677 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f94be49e-5348-4443-9b0d-514aa4a88f2e tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1214 microversion: 2.1 time: 0.067572 Jul 31 20:07:20.539051 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 525/1057] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:20 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:20.736663 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-b5282c23-d7bb-4b3a-9cc7-64bfec76c0f9 req-521dc61d-f63f-49a0-81a9-51776efe523d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642ca76f-9999-4d11-82d6-52e16c8f6207", "tag": "56de90d4-e582-4bc6-9afd-0a7a09dd281e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:07:20.747973 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b5282c23-d7bb-4b3a-9cc7-64bfec76c0f9 req-521dc61d-f63f-49a0-81a9-51776efe523d service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:20.748586 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b5282c23-d7bb-4b3a-9cc7-64bfec76c0f9 req-521dc61d-f63f-49a0-81a9-51776efe523d service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:20.761350 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-b5282c23-d7bb-4b3a-9cc7-64bfec76c0f9 req-521dc61d-f63f-49a0-81a9-51776efe523d service nova] Creating event network-changed:56de90d4-e582-4bc6-9afd-0a7a09dd281e for instance 642ca76f-9999-4d11-82d6-52e16c8f6207 on hv-cinder-84984 Jul 31 20:07:20.766506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-b5282c23-d7bb-4b3a-9cc7-64bfec76c0f9 req-521dc61d-f63f-49a0-81a9-51776efe523d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033714 Jul 31 20:07:20.767469 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 533/1058] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:07:21.547190 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3daab853-b52f-4b98-be88-77df2eb99b5d tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:21.547771 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3daab853-b52f-4b98-be88-77df2eb99b5d tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:21.557572 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3daab853-b52f-4b98-be88-77df2eb99b5d tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:21.557942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3daab853-b52f-4b98-be88-77df2eb99b5d tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:21.558711 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3daab853-b52f-4b98-be88-77df2eb99b5d tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:21.559145 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3daab853-b52f-4b98-be88-77df2eb99b5d tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:21.629332 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3daab853-b52f-4b98-be88-77df2eb99b5d tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:21.646331 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3daab853-b52f-4b98-be88-77df2eb99b5d tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1218 microversion: 2.1 time: 0.102350 Jul 31 20:07:21.646967 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 526/1059] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:21 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:22.671666 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-71062d8e-f8a8-4c8e-ad42-5e03c90eeaa2 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:22.673383 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-71062d8e-f8a8-4c8e-ad42-5e03c90eeaa2 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:22.675401 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:22.682012 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71062d8e-f8a8-4c8e-ad42-5e03c90eeaa2 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:22.682723 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71062d8e-f8a8-4c8e-ad42-5e03c90eeaa2 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:22.684009 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71062d8e-f8a8-4c8e-ad42-5e03c90eeaa2 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:22.684009 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71062d8e-f8a8-4c8e-ad42-5e03c90eeaa2 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:22.763173 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-71062d8e-f8a8-4c8e-ad42-5e03c90eeaa2 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:22.770905 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-71062d8e-f8a8-4c8e-ad42-5e03c90eeaa2 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1272 microversion: 2.1 time: 0.104127 Jul 31 20:07:22.771506 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 534/1060] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:22 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:23.220928 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2ea08832-ee31-44c3-bc65-cd6b7cd6f5db tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:23.221516 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2ea08832-ee31-44c3-bc65-cd6b7cd6f5db tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:23.227965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ea08832-ee31-44c3-bc65-cd6b7cd6f5db tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:23.228392 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ea08832-ee31-44c3-bc65-cd6b7cd6f5db tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:23.229188 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ea08832-ee31-44c3-bc65-cd6b7cd6f5db tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:23.229583 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ea08832-ee31-44c3-bc65-cd6b7cd6f5db tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:23.243438 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-2ea08832-ee31-44c3-bc65-cd6b7cd6f5db tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] HTTP exception thrown: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2ea08832-ee31-44c3-bc65-cd6b7cd6f5db tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Request method failure captured: Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd HTTP/1.1 Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8oAgPkCXFSCXzAwWcomGYGgRCZSqD5PbiKFhgC_8YXoyG3htprDr9Z9Yaub9xmSevREKTKJLFi7HY8G_jurb8fuiDJI53AJfeqZGpKdCviNEzIplzhE1X7OoiIbUzZ2zxBxTC25E0JpZlxAIQxKfLS4RlfGAzdjv5rTbDlbpM6cYc Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: aed33078067c4aa3b0e1d1bf79fd379d Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:07:23.245352 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:07:23.247378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aed33078067c4aa3b0e1d1bf79fd379d"}]}] Jul 31 20:07:23.247378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:23.247378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: aed33078067c4aa3b0e1d1bf79fd379d Jul 31 20:07:23.247378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:23.247378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeShelveTestJSON-1481706984-project Jul 31 20:07:23.247378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:07:23.247378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:07:23.247378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 008286f78ee44232bf411bd695f0c0ed Jul 31 20:07:23.247378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481706984-project Jul 31 20:07:23.247378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:07:23.247378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:23.247378 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '86192351-1ad0-4d52-8496-e85d6e5381dd'} Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:07:23.248266 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:23.250009 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:23.251965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2ea08832-ee31-44c3-bc65-cd6b7cd6f5db tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Returning 404 to user: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:07:23.251965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2ea08832-ee31-44c3-bc65-cd6b7cd6f5db tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "DELETE /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 404 len: 111 microversion: 2.20 time: 0.030494 Jul 31 20:07:23.251965 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 527/1061] 10.222.0.48 () {60 vars in 1280 bytes} [Sun Jul 31 20:07:23 2022] DELETE /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 20:07:23.256590 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-57a4c45c-dddd-4d58-b2e6-7bb24d2da722 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:23.257207 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-57a4c45c-dddd-4d58-b2e6-7bb24d2da722 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: 86192351-1ad0-4d52-8496-e85d6e5381dd] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:23.263922 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57a4c45c-dddd-4d58-b2e6-7bb24d2da722 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:23.264562 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57a4c45c-dddd-4d58-b2e6-7bb24d2da722 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:23.265344 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57a4c45c-dddd-4d58-b2e6-7bb24d2da722 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:23.265772 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57a4c45c-dddd-4d58-b2e6-7bb24d2da722 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:23.278904 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-57a4c45c-dddd-4d58-b2e6-7bb24d2da722 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] HTTP exception thrown: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-57a4c45c-dddd-4d58-b2e6-7bb24d2da722 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Request method failure captured: Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd HTTP/1.1 Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8oAgPkCXFSCXzAwWcomGYGgRCZSqD5PbiKFhgC_8YXoyG3htprDr9Z9Yaub9xmSevREKTKJLFi7HY8G_jurb8fuiDJI53AJfeqZGpKdCviNEzIplzhE1X7OoiIbUzZ2zxBxTC25E0JpZlxAIQxKfLS4RlfGAzdjv5rTbDlbpM6cYc Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: aed33078067c4aa3b0e1d1bf79fd379d Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:07:23.280560 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:07:23.282398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aed33078067c4aa3b0e1d1bf79fd379d"}]}] Jul 31 20:07:23.282398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:23.282398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: aed33078067c4aa3b0e1d1bf79fd379d Jul 31 20:07:23.282398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:23.282398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-1481706984-project Jul 31 20:07:23.282398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:07:23.282398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:07:23.282398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 008286f78ee44232bf411bd695f0c0ed Jul 31 20:07:23.282398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481706984-project Jul 31 20:07:23.282398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:07:23.282398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:23.282398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': '86192351-1ad0-4d52-8496-e85d6e5381dd'} Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:07:23.283339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. Jul 31 20:07:23.284522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:07:23.286683 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-57a4c45c-dddd-4d58-b2e6-7bb24d2da722 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Returning 404 to user: Instance 86192351-1ad0-4d52-8496-e85d6e5381dd could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:07:23.286683 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-57a4c45c-dddd-4d58-b2e6-7bb24d2da722 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd" status: 404 len: 111 microversion: 2.20 time: 0.029361 Jul 31 20:07:23.288098 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 535/1062] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:07:23 2022] GET /compute/v2.1/servers/86192351-1ad0-4d52-8496-e85d6e5381dd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 20:07:23.797499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7302e45f-3cbf-4ffc-ae06-8f8c3d70a044 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:23.797499 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7302e45f-3cbf-4ffc-ae06-8f8c3d70a044 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:23.799817 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7302e45f-3cbf-4ffc-ae06-8f8c3d70a044 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:23.800243 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7302e45f-3cbf-4ffc-ae06-8f8c3d70a044 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:23.801115 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7302e45f-3cbf-4ffc-ae06-8f8c3d70a044 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:23.801609 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7302e45f-3cbf-4ffc-ae06-8f8c3d70a044 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:24.140871 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7302e45f-3cbf-4ffc-ae06-8f8c3d70a044 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:24.150359 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7302e45f-3cbf-4ffc-ae06-8f8c3d70a044 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1314 microversion: 2.1 time: 0.362275 Jul 31 20:07:24.150952 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 528/1063] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:23 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:24.244454 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-e9bea362-220e-46c3-9740-d9f1a40c2f12 req-f9b558a9-d5d9-4244-8452-0fa1e0b4c16f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d24f98fa-aaef-4dca-b211-c214aace5100", "tag": "a3023ad4-6ef0-4062-b8f4-00198ac9e10f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:07:24.256533 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e9bea362-220e-46c3-9740-d9f1a40c2f12 req-f9b558a9-d5d9-4244-8452-0fa1e0b4c16f service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:24.257330 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e9bea362-220e-46c3-9740-d9f1a40c2f12 req-f9b558a9-d5d9-4244-8452-0fa1e0b4c16f service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:24.269141 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-e9bea362-220e-46c3-9740-d9f1a40c2f12 req-f9b558a9-d5d9-4244-8452-0fa1e0b4c16f service nova] Creating event network-changed:a3023ad4-6ef0-4062-b8f4-00198ac9e10f for instance d24f98fa-aaef-4dca-b211-c214aace5100 on hv-cinder-84984 Jul 31 20:07:24.273949 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-e9bea362-220e-46c3-9740-d9f1a40c2f12 req-f9b558a9-d5d9-4244-8452-0fa1e0b4c16f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033516 Jul 31 20:07:24.274546 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 536/1064] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:07:24.421463 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-01ad60e5-6259-4eeb-84a3-7d27c19833d6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:24.422001 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-01ad60e5-6259-4eeb-84a3-7d27c19833d6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:24.428737 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01ad60e5-6259-4eeb-84a3-7d27c19833d6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:24.429191 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01ad60e5-6259-4eeb-84a3-7d27c19833d6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:24.429996 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01ad60e5-6259-4eeb-84a3-7d27c19833d6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:24.430477 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01ad60e5-6259-4eeb-84a3-7d27c19833d6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:24.445058 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-01ad60e5-6259-4eeb-84a3-7d27c19833d6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] HTTP exception thrown: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-01ad60e5-6259-4eeb-84a3-7d27c19833d6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Request method failure captured: Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 HTTP/1.1 Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t8oAgPkCXFSCXzAwWcomGYGgRCZSqD5PbiKFhgC_8YXoyG3htprDr9Z9Yaub9xmSevREKTKJLFi7HY8G_jurb8fuiDJI53AJfeqZGpKdCviNEzIplzhE1X7OoiIbUzZ2zxBxTC25E0JpZlxAIQxKfLS4RlfGAzdjv5rTbDlbpM6cYc Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: aed33078067c4aa3b0e1d1bf79fd379d Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:07:24.446734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:07:24.449450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aed33078067c4aa3b0e1d1bf79fd379d"}]}] Jul 31 20:07:24.449450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:24.449450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: aed33078067c4aa3b0e1d1bf79fd379d Jul 31 20:07:24.449450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:24.449450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeShelveTestJSON-1481706984-project Jul 31 20:07:24.449450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:07:24.449450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:07:24.449450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 008286f78ee44232bf411bd695f0c0ed Jul 31 20:07:24.449450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481706984-project Jul 31 20:07:24.449450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:07:24.449450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:07:24.449450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': 'cdb0b91c-9a78-49a1-a96b-016c09759655'} Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:07:24.450852 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:07:24.454162 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:24.456775 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-01ad60e5-6259-4eeb-84a3-7d27c19833d6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Returning 404 to user: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:07:24.456775 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-01ad60e5-6259-4eeb-84a3-7d27c19833d6 tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 404 len: 111 microversion: 2.20 time: 0.030657 Jul 31 20:07:24.456775 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 529/1065] 10.222.0.48 () {60 vars in 1280 bytes} [Sun Jul 31 20:07:24 2022] DELETE /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 20:07:24.459664 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8def6c03-977c-4130-9757-d76a1167fc7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:24.460350 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8def6c03-977c-4130-9757-d76a1167fc7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] [instance: cdb0b91c-9a78-49a1-a96b-016c09759655] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:24.466841 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8def6c03-977c-4130-9757-d76a1167fc7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:24.467289 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8def6c03-977c-4130-9757-d76a1167fc7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:24.468018 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8def6c03-977c-4130-9757-d76a1167fc7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:24.468662 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8def6c03-977c-4130-9757-d76a1167fc7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:24.482363 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-8def6c03-977c-4130-9757-d76a1167fc7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] HTTP exception thrown: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8def6c03-977c-4130-9757-d76a1167fc7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Request method failure captured: Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 HTTP/1.1 Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t8oAgPkCXFSCXzAwWcomGYGgRCZSqD5PbiKFhgC_8YXoyG3htprDr9Z9Yaub9xmSevREKTKJLFi7HY8G_jurb8fuiDJI53AJfeqZGpKdCviNEzIplzhE1X7OoiIbUzZ2zxBxTC25E0JpZlxAIQxKfLS4RlfGAzdjv5rTbDlbpM6cYc Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: aed33078067c4aa3b0e1d1bf79fd379d Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:07:24.484031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:07:24.485759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aed33078067c4aa3b0e1d1bf79fd379d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aed33078067c4aa3b0e1d1bf79fd379d"}]}] Jul 31 20:07:24.485759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:24.485759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: aed33078067c4aa3b0e1d1bf79fd379d Jul 31 20:07:24.485759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481706984 Jul 31 20:07:24.485759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-1481706984-project Jul 31 20:07:24.485759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:07:24.485759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:07:24.485759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 008286f78ee44232bf411bd695f0c0ed Jul 31 20:07:24.485759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481706984-project Jul 31 20:07:24.485759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:07:24.485759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:07:24.485759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': 'cdb0b91c-9a78-49a1-a96b-016c09759655'} Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:07:24.486629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. Jul 31 20:07:24.488067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:07:24.489405 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8def6c03-977c-4130-9757-d76a1167fc7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] Returning 404 to user: Instance cdb0b91c-9a78-49a1-a96b-016c09759655 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:07:24.489405 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8def6c03-977c-4130-9757-d76a1167fc7f tempest-AttachVolumeShelveTestJSON-1481706984 tempest-AttachVolumeShelveTestJSON-1481706984-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655" status: 404 len: 111 microversion: 2.20 time: 0.031698 Jul 31 20:07:24.489405 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 537/1066] 10.222.0.48 () {60 vars in 1277 bytes} [Sun Jul 31 20:07:24 2022] GET /compute/v2.1/servers/cdb0b91c-9a78-49a1-a96b-016c09759655 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 20:07:25.172383 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5cae2aec-d4c3-47ba-a17c-bcd4b37af427 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:25.173219 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5cae2aec-d4c3-47ba-a17c-bcd4b37af427 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:25.179674 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5cae2aec-d4c3-47ba-a17c-bcd4b37af427 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:25.180100 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5cae2aec-d4c3-47ba-a17c-bcd4b37af427 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:25.180966 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5cae2aec-d4c3-47ba-a17c-bcd4b37af427 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:25.181399 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5cae2aec-d4c3-47ba-a17c-bcd4b37af427 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:25.320954 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5cae2aec-d4c3-47ba-a17c-bcd4b37af427 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:25.328348 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5cae2aec-d4c3-47ba-a17c-bcd4b37af427 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1314 microversion: 2.1 time: 0.160550 Jul 31 20:07:25.328917 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 530/1067] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:25 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:26.349599 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-34595049-abac-4091-9034-3deab7cd24d4 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:26.351071 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-34595049-abac-4091-9034-3deab7cd24d4 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:26.358116 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34595049-abac-4091-9034-3deab7cd24d4 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:26.358535 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34595049-abac-4091-9034-3deab7cd24d4 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:26.359303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34595049-abac-4091-9034-3deab7cd24d4 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:26.359940 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34595049-abac-4091-9034-3deab7cd24d4 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:26.553011 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-34595049-abac-4091-9034-3deab7cd24d4 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:26.564795 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-34595049-abac-4091-9034-3deab7cd24d4 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1314 microversion: 2.1 time: 0.217939 Jul 31 20:07:26.565830 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 538/1068] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:26 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:27.602177 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-30ea52f2-5b19-450d-afe4-6434ebfa6f94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:27.603468 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-30ea52f2-5b19-450d-afe4-6434ebfa6f94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:27.611038 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30ea52f2-5b19-450d-afe4-6434ebfa6f94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:27.611699 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30ea52f2-5b19-450d-afe4-6434ebfa6f94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:27.612806 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30ea52f2-5b19-450d-afe4-6434ebfa6f94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:27.613468 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30ea52f2-5b19-450d-afe4-6434ebfa6f94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:27.910826 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-30ea52f2-5b19-450d-afe4-6434ebfa6f94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:27.918921 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-30ea52f2-5b19-450d-afe4-6434ebfa6f94 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1314 microversion: 2.1 time: 0.326884 Jul 31 20:07:27.919487 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 531/1069] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:27 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:28.941262 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-22ed5df4-1d6d-48d4-a868-37cf4f5b3357 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:28.942473 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-22ed5df4-1d6d-48d4-a868-37cf4f5b3357 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:28.952846 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22ed5df4-1d6d-48d4-a868-37cf4f5b3357 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:28.953934 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22ed5df4-1d6d-48d4-a868-37cf4f5b3357 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:28.955066 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22ed5df4-1d6d-48d4-a868-37cf4f5b3357 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:28.955773 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22ed5df4-1d6d-48d4-a868-37cf4f5b3357 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:29.097745 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-22ed5df4-1d6d-48d4-a868-37cf4f5b3357 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:29.105626 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-22ed5df4-1d6d-48d4-a868-37cf4f5b3357 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1314 microversion: 2.1 time: 0.168998 Jul 31 20:07:29.106339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 539/1070] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:28 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:30.128268 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4d7ea659-4f2e-40a7-811b-d80bd5a4e3ab tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:30.129881 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4d7ea659-4f2e-40a7-811b-d80bd5a4e3ab tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:30.132959 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:30.139054 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4d7ea659-4f2e-40a7-811b-d80bd5a4e3ab tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:30.139784 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4d7ea659-4f2e-40a7-811b-d80bd5a4e3ab tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:30.140759 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4d7ea659-4f2e-40a7-811b-d80bd5a4e3ab tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:30.141184 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4d7ea659-4f2e-40a7-811b-d80bd5a4e3ab tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:30.205747 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-81b3697a-6d14-4c17-aec9-8085d8476ef7 req-642f7416-8e53-470a-9b83-97536f95294e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24f98fa-aaef-4dca-b211-c214aace5100", "name": "network-vif-plugged", "status": "completed", "tag": "a3023ad4-6ef0-4062-b8f4-00198ac9e10f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:07:30.224736 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-81b3697a-6d14-4c17-aec9-8085d8476ef7 req-642f7416-8e53-470a-9b83-97536f95294e service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:30.225600 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-81b3697a-6d14-4c17-aec9-8085d8476ef7 req-642f7416-8e53-470a-9b83-97536f95294e service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:30.238063 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-81b3697a-6d14-4c17-aec9-8085d8476ef7 req-642f7416-8e53-470a-9b83-97536f95294e service nova] Creating event network-vif-plugged:a3023ad4-6ef0-4062-b8f4-00198ac9e10f for instance d24f98fa-aaef-4dca-b211-c214aace5100 on hv-cinder-84984 Jul 31 20:07:30.243709 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-81b3697a-6d14-4c17-aec9-8085d8476ef7 req-642f7416-8e53-470a-9b83-97536f95294e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042620 Jul 31 20:07:30.245375 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 540/1071] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:07:30.320757 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4d7ea659-4f2e-40a7-811b-d80bd5a4e3ab tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:30.329110 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4d7ea659-4f2e-40a7-811b-d80bd5a4e3ab tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1314 microversion: 2.1 time: 0.205498 Jul 31 20:07:30.329789 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 532/1072] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:30 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:31.347139 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:31.348067 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:31.352766 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-52aff3d4-7390-4171-8a9c-fdf9e7277325 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:31.353557 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-52aff3d4-7390-4171-8a9c-fdf9e7277325 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:31.361194 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52aff3d4-7390-4171-8a9c-fdf9e7277325 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:31.361653 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52aff3d4-7390-4171-8a9c-fdf9e7277325 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:31.362427 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52aff3d4-7390-4171-8a9c-fdf9e7277325 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:31.362859 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52aff3d4-7390-4171-8a9c-fdf9e7277325 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:31.564718 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-52aff3d4-7390-4171-8a9c-fdf9e7277325 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:31.572764 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-52aff3d4-7390-4171-8a9c-fdf9e7277325 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1314 microversion: 2.1 time: 0.226448 Jul 31 20:07:31.573578 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 541/1073] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:31 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:32.593067 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0485be85-a72c-44b9-8fd2-c42b51688c01 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:32.593722 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0485be85-a72c-44b9-8fd2-c42b51688c01 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:32.595609 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:32.602979 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0485be85-a72c-44b9-8fd2-c42b51688c01 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:32.603431 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0485be85-a72c-44b9-8fd2-c42b51688c01 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:32.604198 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0485be85-a72c-44b9-8fd2-c42b51688c01 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:32.604634 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0485be85-a72c-44b9-8fd2-c42b51688c01 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:32.749410 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0485be85-a72c-44b9-8fd2-c42b51688c01 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:32.757389 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0485be85-a72c-44b9-8fd2-c42b51688c01 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1497 microversion: 2.1 time: 0.168137 Jul 31 20:07:32.757955 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 533/1074] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:32 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:33.351748 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-42bd9711-c189-4d7d-82f7-6b66d3a72fda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:33.352391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-42bd9711-c189-4d7d-82f7-6b66d3a72fda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:33.358858 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42bd9711-c189-4d7d-82f7-6b66d3a72fda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:33.359307 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42bd9711-c189-4d7d-82f7-6b66d3a72fda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:33.360065 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42bd9711-c189-4d7d-82f7-6b66d3a72fda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:33.360492 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42bd9711-c189-4d7d-82f7-6b66d3a72fda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:33.390847 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-42bd9711-c189-4d7d-82f7-6b66d3a72fda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:07:33.486391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-42bd9711-c189-4d7d-82f7-6b66d3a72fda tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 204 len: 0 microversion: 2.1 time: 0.137741 Jul 31 20:07:33.488060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 542/1075] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:07:33 2022] DELETE /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:07:33.499834 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f03c61a9-4340-4b52-b1b4-a90e22c3f173 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:33.500537 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f03c61a9-4340-4b52-b1b4-a90e22c3f173 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:33.508272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f03c61a9-4340-4b52-b1b4-a90e22c3f173 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:33.508967 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f03c61a9-4340-4b52-b1b4-a90e22c3f173 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:33.509991 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f03c61a9-4340-4b52-b1b4-a90e22c3f173 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:33.510625 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f03c61a9-4340-4b52-b1b4-a90e22c3f173 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:33.642123 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f03c61a9-4340-4b52-b1b4-a90e22c3f173 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:33.650656 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f03c61a9-4340-4b52-b1b4-a90e22c3f173 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1503 microversion: 2.1 time: 0.157966 Jul 31 20:07:33.651226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 534/1076] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:33 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:34.674304 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ac4bdc5a-02d0-4905-b04d-355dd7a4d513 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:34.675740 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ac4bdc5a-02d0-4905-b04d-355dd7a4d513 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:34.685368 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac4bdc5a-02d0-4905-b04d-355dd7a4d513 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:34.685368 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac4bdc5a-02d0-4905-b04d-355dd7a4d513 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:34.685368 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac4bdc5a-02d0-4905-b04d-355dd7a4d513 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:34.685368 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac4bdc5a-02d0-4905-b04d-355dd7a4d513 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:34.838473 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ac4bdc5a-02d0-4905-b04d-355dd7a4d513 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:34.849074 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ac4bdc5a-02d0-4905-b04d-355dd7a4d513 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1503 microversion: 2.1 time: 0.179479 Jul 31 20:07:34.851214 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 543/1077] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:34 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:35.774675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-897ea6d9-a4e2-4c96-b582-f70c243adb83 req-a6312740-c1cb-4b6d-af0e-b5b2d4ada263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24f98fa-aaef-4dca-b211-c214aace5100", "name": "network-vif-deleted", "tag": "a3023ad4-6ef0-4062-b8f4-00198ac9e10f"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:07:35.787351 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-897ea6d9-a4e2-4c96-b582-f70c243adb83 req-a6312740-c1cb-4b6d-af0e-b5b2d4ada263 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:35.788006 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-897ea6d9-a4e2-4c96-b582-f70c243adb83 req-a6312740-c1cb-4b6d-af0e-b5b2d4ada263 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:35.801837 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-897ea6d9-a4e2-4c96-b582-f70c243adb83 req-a6312740-c1cb-4b6d-af0e-b5b2d4ada263 service nova] Creating event network-vif-deleted:a3023ad4-6ef0-4062-b8f4-00198ac9e10f for instance d24f98fa-aaef-4dca-b211-c214aace5100 on hv-cinder-84984 Jul 31 20:07:35.807834 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-897ea6d9-a4e2-4c96-b582-f70c243adb83 req-a6312740-c1cb-4b6d-af0e-b5b2d4ada263 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036666 Jul 31 20:07:35.808701 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 535/1078] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:07:35.872488 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0ce110cb-3ffd-4121-9422-727f8260b0cd tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:35.873263 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0ce110cb-3ffd-4121-9422-727f8260b0cd tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:35.880297 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ce110cb-3ffd-4121-9422-727f8260b0cd tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:35.880745 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ce110cb-3ffd-4121-9422-727f8260b0cd tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:35.881758 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ce110cb-3ffd-4121-9422-727f8260b0cd tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:35.882016 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ce110cb-3ffd-4121-9422-727f8260b0cd tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:35.915688 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:35.964247 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0ce110cb-3ffd-4121-9422-727f8260b0cd tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b11bc570e4f8189c2fd375ef7093c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d67e6c2b804537a7e28c659a293501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:35.972524 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0ce110cb-3ffd-4121-9422-727f8260b0cd tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 200 len: 1299 microversion: 2.1 time: 0.104526 Jul 31 20:07:35.973094 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 544/1079] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:35 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:36.994367 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7cd9cb08-a008-4f85-b4be-520b13b64183 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:36.995346 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7cd9cb08-a008-4f85-b4be-520b13b64183 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] [instance: d24f98fa-aaef-4dca-b211-c214aace5100] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:37.002599 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7cd9cb08-a008-4f85-b4be-520b13b64183 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:37.003048 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7cd9cb08-a008-4f85-b4be-520b13b64183 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:37.003822 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7cd9cb08-a008-4f85-b4be-520b13b64183 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:37.004235 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7cd9cb08-a008-4f85-b4be-520b13b64183 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:37.018236 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-7cd9cb08-a008-4f85-b4be-520b13b64183 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] HTTP exception thrown: Instance d24f98fa-aaef-4dca-b211-c214aace5100 could not be found. Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7cd9cb08-a008-4f85-b4be-520b13b64183 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Request method failure captured: Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 HTTP/1.1 Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5uDeC0M7Zkw2GKjFbmqrH4zgij7f0-TDT2fFrrHd_PufAZG6bN7gos8Dd51AvuzcnJWXgbita03QCq4_egpJkL9Nz4ke6jtK2fhJGRTskCFpQJyvKZhLUjjF1Ig1CzlcDPRP-l8kgcbakPB1pzqGhcX0PIDvBzxet3ROozrid3s09GM Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 74d67e6c2b804537a7e28c659a293501 Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesActionsTest-1757083405 Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:07:37.019796 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:07:37.021445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74d67e6c2b804537a7e28c659a293501"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74d67e6c2b804537a7e28c659a293501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_74d67e6c2b804537a7e28c659a293501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/74d67e6c2b804537a7e28c659a293501"}]}] Jul 31 20:07:37.021445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesActionsTest-1757083405 Jul 31 20:07:37.021445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 74d67e6c2b804537a7e28c659a293501 Jul 31 20:07:37.021445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesActionsTest-1757083405 Jul 31 20:07:37.021445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesActionsTest-1757083405-project Jul 31 20:07:37.021445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:07:37.021445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:07:37.021445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: db8b11bc570e4f8189c2fd375ef7093c Jul 31 20:07:37.021445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesActionsTest-1757083405-project Jul 31 20:07:37.021445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:07:37.021445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance d24f98fa-aaef-4dca-b211-c214aace5100 could not be found. Jul 31 20:07:37.021445 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': 'd24f98fa-aaef-4dca-b211-c214aace5100'} Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d24f98fa-aaef-4dca-b211-c214aace5100 could not be found. Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:07:37.022321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d24f98fa-aaef-4dca-b211-c214aace5100 could not be found. Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d24f98fa-aaef-4dca-b211-c214aace5100 could not be found. Jul 31 20:07:37.023794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:37.025108 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7cd9cb08-a008-4f85-b4be-520b13b64183 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] Returning 404 to user: Instance d24f98fa-aaef-4dca-b211-c214aace5100 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:07:37.025108 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7cd9cb08-a008-4f85-b4be-520b13b64183 tempest-VolumesActionsTest-1757083405 tempest-VolumesActionsTest-1757083405-project] 10.222.0.48 "GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100" status: 404 len: 111 microversion: 2.1 time: 0.031534 Jul 31 20:07:37.025108 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 536/1080] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:36 2022] GET /compute/v2.1/servers/d24f98fa-aaef-4dca-b211-c214aace5100 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:07:49.239985 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-34a998da-ef22-49f2-8840-d63df8e6fa56 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:49.241145 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-34a998da-ef22-49f2-8840-d63df8e6fa56 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:49.243926 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:49.244793 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:49.251424 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-e2f9cf2a-ea0a-42a4-8f15-08ca5b10bb64 req-249d905a-c8aa-49db-89c8-66da60204df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9564a93e-d735-4c3b-916b-8e6c325e4b86", "tag": "5404fa72-b0c7-496c-a13f-4c664ba48b5c"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:07:49.260023 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34a998da-ef22-49f2-8840-d63df8e6fa56 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:49.260690 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34a998da-ef22-49f2-8840-d63df8e6fa56 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:49.260943 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=9 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:49.261754 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=96 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:07:49.265819 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34a998da-ef22-49f2-8840-d63df8e6fa56 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:49.266611 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34a998da-ef22-49f2-8840-d63df8e6fa56 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:49.269080 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e2f9cf2a-ea0a-42a4-8f15-08ca5b10bb64 req-249d905a-c8aa-49db-89c8-66da60204df0 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:49.269623 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e2f9cf2a-ea0a-42a4-8f15-08ca5b10bb64 req-249d905a-c8aa-49db-89c8-66da60204df0 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:49.286907 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-e2f9cf2a-ea0a-42a4-8f15-08ca5b10bb64 req-249d905a-c8aa-49db-89c8-66da60204df0 service nova] Creating event network-changed:5404fa72-b0c7-496c-a13f-4c664ba48b5c for instance 9564a93e-d735-4c3b-916b-8e6c325e4b86 on hv-cinder-84984 Jul 31 20:07:49.293074 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-e2f9cf2a-ea0a-42a4-8f15-08ca5b10bb64 req-249d905a-c8aa-49db-89c8-66da60204df0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048822 Jul 31 20:07:49.294331 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 537/1081] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:07:49.321257 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-34a998da-ef22-49f2-8840-d63df8e6fa56 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:07:49.506519 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-34a998da-ef22-49f2-8840-d63df8e6fa56 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 204 len: 0 microversion: 2.1 time: 0.269960 Jul 31 20:07:49.521624 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1b7b73e4-b208-4a9b-a2b8-e57accc26d2b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:49.522705 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1b7b73e4-b208-4a9b-a2b8-e57accc26d2b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:49.526420 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 545/1082] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:07:49 2022] DELETE /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:07:49.532979 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b7b73e4-b208-4a9b-a2b8-e57accc26d2b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:49.539795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b7b73e4-b208-4a9b-a2b8-e57accc26d2b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:49.540734 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b7b73e4-b208-4a9b-a2b8-e57accc26d2b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:49.541225 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b7b73e4-b208-4a9b-a2b8-e57accc26d2b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:49.787227 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1b7b73e4-b208-4a9b-a2b8-e57accc26d2b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:49.797608 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1b7b73e4-b208-4a9b-a2b8-e57accc26d2b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1566 microversion: 2.1 time: 0.280993 Jul 31 20:07:49.798880 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 538/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:49 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1566 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:50.820313 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-194be653-4347-4662-a078-2e0dcf6a2179 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:50.821419 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-194be653-4347-4662-a078-2e0dcf6a2179 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:50.846408 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-194be653-4347-4662-a078-2e0dcf6a2179 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:50.849405 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-194be653-4347-4662-a078-2e0dcf6a2179 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:50.850582 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-194be653-4347-4662-a078-2e0dcf6a2179 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:50.852168 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-194be653-4347-4662-a078-2e0dcf6a2179 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:51.064605 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-194be653-4347-4662-a078-2e0dcf6a2179 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:51.076318 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-194be653-4347-4662-a078-2e0dcf6a2179 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1566 microversion: 2.1 time: 0.260639 Jul 31 20:07:51.091057 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 546/1084] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:50 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1566 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:51.984990 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-68bdf490-8df9-4ff6-822c-c185d14b635c req-047c691d-6f72-4670-80f1-053b6958f02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9564a93e-d735-4c3b-916b-8e6c325e4b86", "name": "network-vif-deleted", "tag": "5404fa72-b0c7-496c-a13f-4c664ba48b5c"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:07:52.011125 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-68bdf490-8df9-4ff6-822c-c185d14b635c req-047c691d-6f72-4670-80f1-053b6958f02b service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:52.011786 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-68bdf490-8df9-4ff6-822c-c185d14b635c req-047c691d-6f72-4670-80f1-053b6958f02b service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:52.030349 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-68bdf490-8df9-4ff6-822c-c185d14b635c req-047c691d-6f72-4670-80f1-053b6958f02b service nova] Creating event network-vif-deleted:5404fa72-b0c7-496c-a13f-4c664ba48b5c for instance 9564a93e-d735-4c3b-916b-8e6c325e4b86 on hv-cinder-84984 Jul 31 20:07:52.036657 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-68bdf490-8df9-4ff6-822c-c185d14b635c req-047c691d-6f72-4670-80f1-053b6958f02b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056364 Jul 31 20:07:52.037492 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 539/1085] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:07:52.316240 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b71cec39-e454-45ce-8483-e71c4d88ce58 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:52.316901 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b71cec39-e454-45ce-8483-e71c4d88ce58 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:52.340988 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b71cec39-e454-45ce-8483-e71c4d88ce58 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:52.341485 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b71cec39-e454-45ce-8483-e71c4d88ce58 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:52.342262 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b71cec39-e454-45ce-8483-e71c4d88ce58 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:52.342691 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b71cec39-e454-45ce-8483-e71c4d88ce58 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:52.459053 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b71cec39-e454-45ce-8483-e71c4d88ce58 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f54d49acf0427e843caddf99e66277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a9021b3b804f58a2a4e73676bfc480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:07:52.470230 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b71cec39-e454-45ce-8483-e71c4d88ce58 tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 200 len: 1218 microversion: 2.1 time: 0.375913 Jul 31 20:07:52.484607 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 547/1086] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:52 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 1218 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:07:53.492818 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1f17b859-c9dc-404f-a993-d32a5860c26d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:53.493756 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1f17b859-c9dc-404f-a993-d32a5860c26d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] [instance: 9564a93e-d735-4c3b-916b-8e6c325e4b86] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:07:53.501600 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f17b859-c9dc-404f-a993-d32a5860c26d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:53.502368 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f17b859-c9dc-404f-a993-d32a5860c26d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:53.503402 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f17b859-c9dc-404f-a993-d32a5860c26d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:07:53.504095 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f17b859-c9dc-404f-a993-d32a5860c26d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:07:53.521755 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-1f17b859-c9dc-404f-a993-d32a5860c26d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] HTTP exception thrown: Instance 9564a93e-d735-4c3b-916b-8e6c325e4b86 could not be found. Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1f17b859-c9dc-404f-a993-d32a5860c26d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Request method failure captured: Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 HTTP/1.1 Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t_iw7Rrb28-GGyD7kTCjg_jHYcE6NjhTYBgC4CRreIc62Nc-r1-qKQw-7kXUwagmt_trUqxNIShEnDlqC2IppCnMUIJC4tm5KzQ1rRSmSI2d9A3k3N68ujrNcnFrnWPtgv8GoILOQU-qiV-Q8cQlIrcxHZp7b82yFjNxCsS-HmIIuE Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: d5a9021b3b804f58a2a4e73676bfc480 Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestShelveInstance-1571365619 Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:07:53.523804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:07:53.525556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5a9021b3b804f58a2a4e73676bfc480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5a9021b3b804f58a2a4e73676bfc480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d5a9021b3b804f58a2a4e73676bfc480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d5a9021b3b804f58a2a4e73676bfc480"}]}] Jul 31 20:07:53.525556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestShelveInstance-1571365619 Jul 31 20:07:53.525556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: d5a9021b3b804f58a2a4e73676bfc480 Jul 31 20:07:53.525556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestShelveInstance-1571365619 Jul 31 20:07:53.525556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-TestShelveInstance-1571365619-project Jul 31 20:07:53.525556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:07:53.525556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:07:53.525556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 73f54d49acf0427e843caddf99e66277 Jul 31 20:07:53.525556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestShelveInstance-1571365619-project Jul 31 20:07:53.525556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:07:53.525556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance 9564a93e-d735-4c3b-916b-8e6c325e4b86 could not be found. Jul 31 20:07:53.525556 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '9564a93e-d735-4c3b-916b-8e6c325e4b86'} Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9564a93e-d735-4c3b-916b-8e6c325e4b86 could not be found. Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:07:53.526559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9564a93e-d735-4c3b-916b-8e6c325e4b86 could not be found. Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9564a93e-d735-4c3b-916b-8e6c325e4b86 could not be found. Jul 31 20:07:53.528360 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:07:53.530414 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1f17b859-c9dc-404f-a993-d32a5860c26d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Returning 404 to user: Instance 9564a93e-d735-4c3b-916b-8e6c325e4b86 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:07:53.531419 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1f17b859-c9dc-404f-a993-d32a5860c26d tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86" status: 404 len: 111 microversion: 2.1 time: 0.042929 Jul 31 20:07:53.549291 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 540/1087] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:07:53 2022] GET /compute/v2.1/servers/9564a93e-d735-4c3b-916b-8e6c325e4b86 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:07:53.734915 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-df16e187-6caa-4bb5-9f6b-e71ca187438b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] Calling method '.version_select at 0x7ffa248dfdc0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:07:53.781665 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-df16e187-6caa-4bb5-9f6b-e71ca187438b tempest-TestShelveInstance-1571365619 tempest-TestShelveInstance-1571365619-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1722570919" status: 202 len: 0 microversion: 2.1 time: 0.050331 Jul 31 20:07:53.782495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 548/1088] 10.222.0.48 () {58 vars in 1254 bytes} [Sun Jul 31 20:07:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1722570919 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:07:57.417107 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 20:07:57.417925 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Sun Jul 31 20:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 20:08:06.551927 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-362362070", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "networks": [{"uuid": "6ad1e1ec-553c-4a12-a4b9-27cfdf170446"}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:08:06.560949 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=8 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:06.561614 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=12 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:06.608643 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] validate_networks() for [('6ad1e1ec-553c-4a12-a4b9-27cfdf170446', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:08:06.976491 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:08:06.977100 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:08:06.977583 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:08:06.977987 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:08:06.978648 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:08:06.988205 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:06.988641 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:06.989467 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:06.989895 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:07.007313 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Getting quotas for project 90341435be0e46008416d3afb9d9cf90. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:08:07.011724 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Getting quotas for user 1e943453c5734f99bce435117e202b8e and project 90341435be0e46008416d3afb9d9cf90. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:08:07.023231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:08:07.025587 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:08:07.073020 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-503859bf-d6e2-4132-ad70-3ac2ba78f58f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524968 Jul 31 20:08:07.073686 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 541/1089] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:08:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:08:07.084831 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-60344ed9-4169-4bd9-8fca-22f2bcbb97c1 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:07.085482 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-60344ed9-4169-4bd9-8fca-22f2bcbb97c1 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:07.089644 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:07.090653 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:07.150360 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-60344ed9-4169-4bd9-8fca-22f2bcbb97c1 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:07.157376 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-60344ed9-4169-4bd9-8fca-22f2bcbb97c1 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1218 microversion: 2.1 time: 0.076539 Jul 31 20:08:07.157955 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 549/1090] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:07 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:08:08.182876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-77c06b41-a3cf-4c5f-9e6b-1b20805a817a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:08.183472 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-77c06b41-a3cf-4c5f-9e6b-1b20805a817a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:08.194256 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77c06b41-a3cf-4c5f-9e6b-1b20805a817a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:08.194900 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77c06b41-a3cf-4c5f-9e6b-1b20805a817a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:08.195969 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77c06b41-a3cf-4c5f-9e6b-1b20805a817a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:08.196575 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77c06b41-a3cf-4c5f-9e6b-1b20805a817a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:08.259531 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-77c06b41-a3cf-4c5f-9e6b-1b20805a817a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:08.267242 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-77c06b41-a3cf-4c5f-9e6b-1b20805a817a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1222 microversion: 2.1 time: 0.091486 Jul 31 20:08:08.267795 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 542/1091] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:08 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:09.288379 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-385498e9-4870-4845-a385-0f48adf47bf6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:09.288942 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-385498e9-4870-4845-a385-0f48adf47bf6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:09.295857 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-385498e9-4870-4845-a385-0f48adf47bf6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:09.296304 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-385498e9-4870-4845-a385-0f48adf47bf6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:09.297060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-385498e9-4870-4845-a385-0f48adf47bf6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:09.297522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-385498e9-4870-4845-a385-0f48adf47bf6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:09.363872 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-385498e9-4870-4845-a385-0f48adf47bf6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:09.371749 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-385498e9-4870-4845-a385-0f48adf47bf6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1270 microversion: 2.1 time: 0.087616 Jul 31 20:08:09.372303 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 550/1092] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:09 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:10.394232 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8ffd7f35-83f9-45d1-bc35-4f05b90df87d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:10.395259 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8ffd7f35-83f9-45d1-bc35-4f05b90df87d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:10.401919 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ffd7f35-83f9-45d1-bc35-4f05b90df87d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:10.402614 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ffd7f35-83f9-45d1-bc35-4f05b90df87d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:10.403669 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ffd7f35-83f9-45d1-bc35-4f05b90df87d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:10.404405 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ffd7f35-83f9-45d1-bc35-4f05b90df87d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:10.625114 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8ffd7f35-83f9-45d1-bc35-4f05b90df87d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:10.633106 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8ffd7f35-83f9-45d1-bc35-4f05b90df87d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1318 microversion: 2.1 time: 0.243825 Jul 31 20:08:10.633760 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 543/1093] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:10 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:10.921121 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-03ca780e-0eaf-40ef-9665-e687a69e958a req-c812c39d-0b54-4e48-a3ce-4d55f13a8bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d", "tag": "6f2291ee-a544-4d8a-86c7-413a6ff44e29"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:08:10.931877 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-03ca780e-0eaf-40ef-9665-e687a69e958a req-c812c39d-0b54-4e48-a3ce-4d55f13a8bdf service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:10.932404 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-03ca780e-0eaf-40ef-9665-e687a69e958a req-c812c39d-0b54-4e48-a3ce-4d55f13a8bdf service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:10.943572 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-03ca780e-0eaf-40ef-9665-e687a69e958a req-c812c39d-0b54-4e48-a3ce-4d55f13a8bdf service nova] Creating event network-changed:6f2291ee-a544-4d8a-86c7-413a6ff44e29 for instance bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d on hv-cinder-84984 Jul 31 20:08:10.948827 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-03ca780e-0eaf-40ef-9665-e687a69e958a req-c812c39d-0b54-4e48-a3ce-4d55f13a8bdf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031517 Jul 31 20:08:10.949635 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 551/1094] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:08:11.654885 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c1cb3ef0-2ae6-4485-b1fa-85a767146f8a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:11.655681 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c1cb3ef0-2ae6-4485-b1fa-85a767146f8a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:11.662251 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1cb3ef0-2ae6-4485-b1fa-85a767146f8a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:11.662684 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1cb3ef0-2ae6-4485-b1fa-85a767146f8a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:11.663462 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1cb3ef0-2ae6-4485-b1fa-85a767146f8a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:11.663888 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1cb3ef0-2ae6-4485-b1fa-85a767146f8a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:11.803108 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c1cb3ef0-2ae6-4485-b1fa-85a767146f8a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:11.813058 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c1cb3ef0-2ae6-4485-b1fa-85a767146f8a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1318 microversion: 2.1 time: 0.161986 Jul 31 20:08:11.813816 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 544/1095] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:11 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:08:12.842762 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-593a8fbd-6839-405b-bcc8-7638a9019443 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:12.843892 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-593a8fbd-6839-405b-bcc8-7638a9019443 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:12.852848 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-593a8fbd-6839-405b-bcc8-7638a9019443 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:12.853547 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-593a8fbd-6839-405b-bcc8-7638a9019443 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:12.854618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-593a8fbd-6839-405b-bcc8-7638a9019443 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:12.855231 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-593a8fbd-6839-405b-bcc8-7638a9019443 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:13.001391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-593a8fbd-6839-405b-bcc8-7638a9019443 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:13.009364 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-593a8fbd-6839-405b-bcc8-7638a9019443 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1318 microversion: 2.1 time: 0.173333 Jul 31 20:08:13.009941 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 552/1096] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:12 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:14.034837 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ab6e17c6-7a6b-403b-b7b4-2910b72c499f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:14.035675 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ab6e17c6-7a6b-403b-b7b4-2910b72c499f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:14.046648 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab6e17c6-7a6b-403b-b7b4-2910b72c499f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:14.047087 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab6e17c6-7a6b-403b-b7b4-2910b72c499f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:14.047849 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab6e17c6-7a6b-403b-b7b4-2910b72c499f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:14.048453 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab6e17c6-7a6b-403b-b7b4-2910b72c499f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:14.187097 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ab6e17c6-7a6b-403b-b7b4-2910b72c499f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:14.195581 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ab6e17c6-7a6b-403b-b7b4-2910b72c499f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1318 microversion: 2.1 time: 0.167427 Jul 31 20:08:14.196147 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 545/1097] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:14 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:15.216134 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b9f0e0d3-7217-471f-97de-6c140a95fda9 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:15.216718 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b9f0e0d3-7217-471f-97de-6c140a95fda9 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:15.223804 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9f0e0d3-7217-471f-97de-6c140a95fda9 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:15.224249 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9f0e0d3-7217-471f-97de-6c140a95fda9 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:15.225015 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9f0e0d3-7217-471f-97de-6c140a95fda9 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:15.225477 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9f0e0d3-7217-471f-97de-6c140a95fda9 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:15.437609 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b9f0e0d3-7217-471f-97de-6c140a95fda9 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:15.445758 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b9f0e0d3-7217-471f-97de-6c140a95fda9 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1318 microversion: 2.1 time: 0.233518 Jul 31 20:08:15.446702 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 553/1098] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:15 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:16.467199 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8f0d9f1f-65a7-4e17-9c2f-1335aa3ef174 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:16.467781 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8f0d9f1f-65a7-4e17-9c2f-1335aa3ef174 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:16.474512 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8f0d9f1f-65a7-4e17-9c2f-1335aa3ef174 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:16.474950 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8f0d9f1f-65a7-4e17-9c2f-1335aa3ef174 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:16.475704 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8f0d9f1f-65a7-4e17-9c2f-1335aa3ef174 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:16.476126 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8f0d9f1f-65a7-4e17-9c2f-1335aa3ef174 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:16.614912 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8f0d9f1f-65a7-4e17-9c2f-1335aa3ef174 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:16.628950 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8f0d9f1f-65a7-4e17-9c2f-1335aa3ef174 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1318 microversion: 2.1 time: 0.165712 Jul 31 20:08:16.629546 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 546/1099] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:16 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:16.992013 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-b954bf85-c4e1-4f9c-a7bf-9f4e01c4a5c7 req-bf23dace-67c9-42f4-beb3-5c4a7a598e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d", "name": "network-vif-plugged", "status": "completed", "tag": "6f2291ee-a544-4d8a-86c7-413a6ff44e29"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:08:17.004045 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b954bf85-c4e1-4f9c-a7bf-9f4e01c4a5c7 req-bf23dace-67c9-42f4-beb3-5c4a7a598e21 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:17.004486 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b954bf85-c4e1-4f9c-a7bf-9f4e01c4a5c7 req-bf23dace-67c9-42f4-beb3-5c4a7a598e21 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:17.016238 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-b954bf85-c4e1-4f9c-a7bf-9f4e01c4a5c7 req-bf23dace-67c9-42f4-beb3-5c4a7a598e21 service nova] Creating event network-vif-plugged:6f2291ee-a544-4d8a-86c7-413a6ff44e29 for instance bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d on hv-cinder-84984 Jul 31 20:08:17.021608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-b954bf85-c4e1-4f9c-a7bf-9f4e01c4a5c7 req-bf23dace-67c9-42f4-beb3-5c4a7a598e21 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033259 Jul 31 20:08:17.022228 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 554/1100] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:08:17.658408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-32c6f8df-6da2-479e-96e1-34643e06a8ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:17.658995 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-32c6f8df-6da2-479e-96e1-34643e06a8ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:17.660902 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:17.661586 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:17.668418 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32c6f8df-6da2-479e-96e1-34643e06a8ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:17.668879 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32c6f8df-6da2-479e-96e1-34643e06a8ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:17.669720 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32c6f8df-6da2-479e-96e1-34643e06a8ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:17.670207 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32c6f8df-6da2-479e-96e1-34643e06a8ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:17.811993 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-32c6f8df-6da2-479e-96e1-34643e06a8ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:17.819636 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-32c6f8df-6da2-479e-96e1-34643e06a8ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1318 microversion: 2.1 time: 0.166669 Jul 31 20:08:17.820205 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 547/1101] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:17 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:18.839607 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:18.846805 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dde89b53-fb52-4216-9555-6d6c0c25ee07 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:18.847529 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dde89b53-fb52-4216-9555-6d6c0c25ee07 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:18.854629 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dde89b53-fb52-4216-9555-6d6c0c25ee07 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:18.855073 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dde89b53-fb52-4216-9555-6d6c0c25ee07 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:18.855834 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dde89b53-fb52-4216-9555-6d6c0c25ee07 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:18.856267 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dde89b53-fb52-4216-9555-6d6c0c25ee07 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:18.995681 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dde89b53-fb52-4216-9555-6d6c0c25ee07 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:19.004131 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dde89b53-fb52-4216-9555-6d6c0c25ee07 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1507 microversion: 2.1 time: 0.166298 Jul 31 20:08:19.004792 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 555/1102] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:18 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:22.622321 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-489043594", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:08:22.674233 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] validate_networks() for None {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:08:22.962175 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:08:22.962592 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:08:22.963058 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:08:22.963450 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:08:22.963872 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:08:22.973578 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:22.974030 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:22.974822 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:22.975255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:22.992550 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Getting quotas for project 9fe05c5b08d340efb6ecfc89d5bdcf17. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:08:22.996970 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Getting quotas for user ba40cc7039e64891af93ee67ee92ec9a and project 9fe05c5b08d340efb6ecfc89d5bdcf17. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:08:23.008690 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:08:23.010887 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:08:23.055361 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-251e7dc8-f439-4537-9fb6-1a7c18f83e10 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.437214 Jul 31 20:08:23.056007 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 548/1103] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:08:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:08:23.067911 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-56e11c86-7d51-41ea-8757-520932e4eed1 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:23.068453 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-56e11c86-7d51-41ea-8757-520932e4eed1 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:23.125732 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-56e11c86-7d51-41ea-8757-520932e4eed1 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:23.133221 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-56e11c86-7d51-41ea-8757-520932e4eed1 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1214 microversion: 2.1 time: 0.069481 Jul 31 20:08:23.133929 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 556/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:23 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:24.155842 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-207a51a9-85b3-49a3-a81c-caee99c9f4b3 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:24.156476 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-207a51a9-85b3-49a3-a81c-caee99c9f4b3 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:24.166092 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-207a51a9-85b3-49a3-a81c-caee99c9f4b3 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:24.166966 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-207a51a9-85b3-49a3-a81c-caee99c9f4b3 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:24.167978 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-207a51a9-85b3-49a3-a81c-caee99c9f4b3 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:24.168612 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-207a51a9-85b3-49a3-a81c-caee99c9f4b3 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:24.262100 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-207a51a9-85b3-49a3-a81c-caee99c9f4b3 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:24.270618 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-207a51a9-85b3-49a3-a81c-caee99c9f4b3 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1274 microversion: 2.1 time: 0.119253 Jul 31 20:08:24.271213 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 549/1105] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:24 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:25.292568 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8239d26f-d808-4116-a511-76d6f50ea838 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:25.293246 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8239d26f-d808-4116-a511-76d6f50ea838 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:25.301185 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8239d26f-d808-4116-a511-76d6f50ea838 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:25.301643 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8239d26f-d808-4116-a511-76d6f50ea838 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:25.302431 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8239d26f-d808-4116-a511-76d6f50ea838 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:25.302861 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8239d26f-d808-4116-a511-76d6f50ea838 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:25.695296 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8239d26f-d808-4116-a511-76d6f50ea838 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:25.703180 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8239d26f-d808-4116-a511-76d6f50ea838 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1314 microversion: 2.1 time: 0.414529 Jul 31 20:08:25.704001 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 557/1106] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:25 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:25.984780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-90048c15-d6a5-40b9-bf87-5570ed341b19 req-c110fedb-44bb-42c5-8681-75cd5deb8463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750991ae-1a9e-41c2-a853-44e8ba64d53e", "tag": "b505347a-1eb7-42a2-9108-c1ba60bb56be"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:08:25.995906 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-90048c15-d6a5-40b9-bf87-5570ed341b19 req-c110fedb-44bb-42c5-8681-75cd5deb8463 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:25.996763 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-90048c15-d6a5-40b9-bf87-5570ed341b19 req-c110fedb-44bb-42c5-8681-75cd5deb8463 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:26.008578 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-90048c15-d6a5-40b9-bf87-5570ed341b19 req-c110fedb-44bb-42c5-8681-75cd5deb8463 service nova] Creating event network-changed:b505347a-1eb7-42a2-9108-c1ba60bb56be for instance 750991ae-1a9e-41c2-a853-44e8ba64d53e on hv-cinder-84984 Jul 31 20:08:26.014309 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-90048c15-d6a5-40b9-bf87-5570ed341b19 req-c110fedb-44bb-42c5-8681-75cd5deb8463 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033529 Jul 31 20:08:26.014963 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 550/1107] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:08:26.727456 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-19dec89b-dbde-40f0-839b-a0837ccbbffe tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:26.728250 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-19dec89b-dbde-40f0-839b-a0837ccbbffe tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:26.737256 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19dec89b-dbde-40f0-839b-a0837ccbbffe tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:26.737750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19dec89b-dbde-40f0-839b-a0837ccbbffe tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:26.738521 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19dec89b-dbde-40f0-839b-a0837ccbbffe tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:26.738952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19dec89b-dbde-40f0-839b-a0837ccbbffe tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:26.880801 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-19dec89b-dbde-40f0-839b-a0837ccbbffe tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:26.889847 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-19dec89b-dbde-40f0-839b-a0837ccbbffe tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1314 microversion: 2.1 time: 0.166937 Jul 31 20:08:26.890644 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 558/1108] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:26 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:27.912865 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-148aedc0-4000-4869-a5d1-acee27f62900 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:27.913714 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-148aedc0-4000-4869-a5d1-acee27f62900 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:27.920355 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-148aedc0-4000-4869-a5d1-acee27f62900 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:27.921245 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-148aedc0-4000-4869-a5d1-acee27f62900 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:27.922353 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-148aedc0-4000-4869-a5d1-acee27f62900 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:27.922861 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-148aedc0-4000-4869-a5d1-acee27f62900 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:28.070027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-148aedc0-4000-4869-a5d1-acee27f62900 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:28.077960 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-148aedc0-4000-4869-a5d1-acee27f62900 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1314 microversion: 2.1 time: 0.169936 Jul 31 20:08:28.078530 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 551/1109] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:27 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:29.099112 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-af9ae1cc-1b31-4364-8d8e-b98febaa6e84 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:29.099715 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-af9ae1cc-1b31-4364-8d8e-b98febaa6e84 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:29.107060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af9ae1cc-1b31-4364-8d8e-b98febaa6e84 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:29.107503 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af9ae1cc-1b31-4364-8d8e-b98febaa6e84 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:29.108255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af9ae1cc-1b31-4364-8d8e-b98febaa6e84 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:29.108679 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af9ae1cc-1b31-4364-8d8e-b98febaa6e84 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:29.254058 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-af9ae1cc-1b31-4364-8d8e-b98febaa6e84 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:29.266656 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-af9ae1cc-1b31-4364-8d8e-b98febaa6e84 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1314 microversion: 2.1 time: 0.171202 Jul 31 20:08:29.267401 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 559/1110] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:29 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:30.294263 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-af913769-7bfd-4a22-8d37-4047051edfe5 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:30.295242 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-af913769-7bfd-4a22-8d37-4047051edfe5 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:30.306084 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af913769-7bfd-4a22-8d37-4047051edfe5 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:30.306528 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af913769-7bfd-4a22-8d37-4047051edfe5 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:30.307289 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af913769-7bfd-4a22-8d37-4047051edfe5 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:30.307721 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af913769-7bfd-4a22-8d37-4047051edfe5 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:30.443696 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-af913769-7bfd-4a22-8d37-4047051edfe5 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:30.451640 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-af913769-7bfd-4a22-8d37-4047051edfe5 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1314 microversion: 2.1 time: 0.164037 Jul 31 20:08:30.452203 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 552/1111] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:30 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:31.476157 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-50c5a42e-4841-45d8-9970-f3cdc3044642 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:31.477282 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-50c5a42e-4841-45d8-9970-f3cdc3044642 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:31.484110 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50c5a42e-4841-45d8-9970-f3cdc3044642 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:31.484555 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50c5a42e-4841-45d8-9970-f3cdc3044642 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:31.485361 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50c5a42e-4841-45d8-9970-f3cdc3044642 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:31.485795 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50c5a42e-4841-45d8-9970-f3cdc3044642 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:31.618180 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-50c5a42e-4841-45d8-9970-f3cdc3044642 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:31.626165 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-50c5a42e-4841-45d8-9970-f3cdc3044642 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1314 microversion: 2.1 time: 0.156703 Jul 31 20:08:31.626760 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 560/1112] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:31 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:32.651425 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-dadeb6d1-97da-4283-9916-bdac69670097 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:32.652570 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-dadeb6d1-97da-4283-9916-bdac69670097 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:32.663552 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dadeb6d1-97da-4283-9916-bdac69670097 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:32.664290 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dadeb6d1-97da-4283-9916-bdac69670097 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:32.665283 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dadeb6d1-97da-4283-9916-bdac69670097 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:32.665713 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dadeb6d1-97da-4283-9916-bdac69670097 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:32.799694 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dadeb6d1-97da-4283-9916-bdac69670097 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:32.807776 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-dadeb6d1-97da-4283-9916-bdac69670097 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1314 microversion: 2.1 time: 0.162979 Jul 31 20:08:32.808344 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 553/1113] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:32 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:33.050080 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-7a24f52d-6a85-4617-adba-8d01cb923e31 req-b977b566-e7b4-4a76-bc11-f82488e92b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750991ae-1a9e-41c2-a853-44e8ba64d53e", "name": "network-vif-plugged", "status": "completed", "tag": "b505347a-1eb7-42a2-9108-c1ba60bb56be"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:08:33.061840 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7a24f52d-6a85-4617-adba-8d01cb923e31 req-b977b566-e7b4-4a76-bc11-f82488e92b44 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:33.062265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7a24f52d-6a85-4617-adba-8d01cb923e31 req-b977b566-e7b4-4a76-bc11-f82488e92b44 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:33.074240 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-7a24f52d-6a85-4617-adba-8d01cb923e31 req-b977b566-e7b4-4a76-bc11-f82488e92b44 service nova] Creating event network-vif-plugged:b505347a-1eb7-42a2-9108-c1ba60bb56be for instance 750991ae-1a9e-41c2-a853-44e8ba64d53e on hv-cinder-84984 Jul 31 20:08:33.079459 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-7a24f52d-6a85-4617-adba-8d01cb923e31 req-b977b566-e7b4-4a76-bc11-f82488e92b44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033600 Jul 31 20:08:33.080429 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 561/1114] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:08:33.832498 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-50236d2d-f0f5-49fc-ac4f-a9f94e237fc0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:33.833552 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-50236d2d-f0f5-49fc-ac4f-a9f94e237fc0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:33.836636 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:33.837319 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:33.843870 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-50236d2d-f0f5-49fc-ac4f-a9f94e237fc0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:33.844303 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-50236d2d-f0f5-49fc-ac4f-a9f94e237fc0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:33.845078 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-50236d2d-f0f5-49fc-ac4f-a9f94e237fc0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:33.845539 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-50236d2d-f0f5-49fc-ac4f-a9f94e237fc0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:33.977536 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-50236d2d-f0f5-49fc-ac4f-a9f94e237fc0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:33.985236 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-50236d2d-f0f5-49fc-ac4f-a9f94e237fc0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1314 microversion: 2.1 time: 0.159322 Jul 31 20:08:33.985798 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 554/1115] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:33 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:34.240372 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-33423d3d-fab7-4df9-9fad-d6492c2861ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "923f9e03-f281-454b-9b45-5983d4963955", "device": "/dev/sdb"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:08:34.243499 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-33423d3d-fab7-4df9-9fad-d6492c2861ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:34.245755 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:34.255107 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33423d3d-fab7-4df9-9fad-d6492c2861ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:34.255712 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33423d3d-fab7-4df9-9fad-d6492c2861ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:34.256893 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33423d3d-fab7-4df9-9fad-d6492c2861ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:34.257549 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33423d3d-fab7-4df9-9fad-d6492c2861ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:34.536559 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-33423d3d-fab7-4df9-9fad-d6492c2861ed tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "POST /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300401 Jul 31 20:08:34.537204 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 562/1116] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:08:34 2022] POST /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:08:35.010099 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-99bb7c57-6e65-4faf-bbfe-b8253fbe7aa0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:35.010866 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-99bb7c57-6e65-4faf-bbfe-b8253fbe7aa0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:35.019383 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99bb7c57-6e65-4faf-bbfe-b8253fbe7aa0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:35.019944 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99bb7c57-6e65-4faf-bbfe-b8253fbe7aa0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:35.020892 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99bb7c57-6e65-4faf-bbfe-b8253fbe7aa0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:35.021484 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99bb7c57-6e65-4faf-bbfe-b8253fbe7aa0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:35.171658 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-99bb7c57-6e65-4faf-bbfe-b8253fbe7aa0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:35.181046 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-99bb7c57-6e65-4faf-bbfe-b8253fbe7aa0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1314 microversion: 2.1 time: 0.177351 Jul 31 20:08:35.181612 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 555/1117] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:35 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:36.206876 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dc13ca37-3eb5-4a55-a95b-ee9b41733ae0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:36.207866 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dc13ca37-3eb5-4a55-a95b-ee9b41733ae0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:36.216903 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc13ca37-3eb5-4a55-a95b-ee9b41733ae0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:36.217390 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc13ca37-3eb5-4a55-a95b-ee9b41733ae0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:36.218160 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc13ca37-3eb5-4a55-a95b-ee9b41733ae0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:36.218576 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc13ca37-3eb5-4a55-a95b-ee9b41733ae0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:36.359235 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dc13ca37-3eb5-4a55-a95b-ee9b41733ae0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:36.367145 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dc13ca37-3eb5-4a55-a95b-ee9b41733ae0 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1464 microversion: 2.1 time: 0.167697 Jul 31 20:08:36.367912 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 563/1118] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:36 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1464 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:36.414843 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e30db098-c1be-499f-beb7-c4a807fbc1e6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:36.415428 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e30db098-c1be-499f-beb7-c4a807fbc1e6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:36.422245 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e30db098-c1be-499f-beb7-c4a807fbc1e6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:36.422692 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e30db098-c1be-499f-beb7-c4a807fbc1e6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:36.423449 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e30db098-c1be-499f-beb7-c4a807fbc1e6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:36.423881 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e30db098-c1be-499f-beb7-c4a807fbc1e6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:36.451559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e30db098-c1be-499f-beb7-c4a807fbc1e6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:08:36.533466 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e30db098-c1be-499f-beb7-c4a807fbc1e6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "DELETE /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 204 len: 0 microversion: 2.1 time: 0.124585 Jul 31 20:08:36.534072 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 556/1119] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:08:36 2022] DELETE /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:08:36.542790 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6dbbbaa5-0045-4f1f-8858-4fd4573c6c58 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:36.543508 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6dbbbaa5-0045-4f1f-8858-4fd4573c6c58 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:36.550124 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dbbbaa5-0045-4f1f-8858-4fd4573c6c58 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:36.550574 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dbbbaa5-0045-4f1f-8858-4fd4573c6c58 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:36.551337 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dbbbaa5-0045-4f1f-8858-4fd4573c6c58 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:36.551768 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dbbbaa5-0045-4f1f-8858-4fd4573c6c58 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:36.698060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6dbbbaa5-0045-4f1f-8858-4fd4573c6c58 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:36.706201 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6dbbbaa5-0045-4f1f-8858-4fd4573c6c58 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1470 microversion: 2.1 time: 0.167312 Jul 31 20:08:36.706845 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 564/1120] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:36 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:37.728988 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f3f5e3c2-5be7-483d-8a57-ee5ebd2bb9e1 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:37.729817 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f3f5e3c2-5be7-483d-8a57-ee5ebd2bb9e1 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:37.732334 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:37.738025 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3f5e3c2-5be7-483d-8a57-ee5ebd2bb9e1 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:37.738490 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3f5e3c2-5be7-483d-8a57-ee5ebd2bb9e1 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:37.739346 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3f5e3c2-5be7-483d-8a57-ee5ebd2bb9e1 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:37.739828 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3f5e3c2-5be7-483d-8a57-ee5ebd2bb9e1 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:37.743468 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:37.878874 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f3f5e3c2-5be7-483d-8a57-ee5ebd2bb9e1 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:37.889146 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f3f5e3c2-5be7-483d-8a57-ee5ebd2bb9e1 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1470 microversion: 2.1 time: 0.164650 Jul 31 20:08:37.889804 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 557/1121] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:37 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:38.602568 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-c5e3d6f5-406f-40a6-9161-0500055ddfff req-61338725-c49c-492c-8d0f-ba852665f703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750991ae-1a9e-41c2-a853-44e8ba64d53e", "name": "network-vif-deleted", "tag": "b505347a-1eb7-42a2-9108-c1ba60bb56be"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:08:38.608877 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=37 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:38.615634 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c5e3d6f5-406f-40a6-9161-0500055ddfff req-61338725-c49c-492c-8d0f-ba852665f703 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:38.616077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c5e3d6f5-406f-40a6-9161-0500055ddfff req-61338725-c49c-492c-8d0f-ba852665f703 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:38.619160 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:38.633074 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-c5e3d6f5-406f-40a6-9161-0500055ddfff req-61338725-c49c-492c-8d0f-ba852665f703 service nova] Creating event network-vif-deleted:b505347a-1eb7-42a2-9108-c1ba60bb56be for instance 750991ae-1a9e-41c2-a853-44e8ba64d53e on hv-cinder-84984 Jul 31 20:08:38.638460 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-c5e3d6f5-406f-40a6-9161-0500055ddfff req-61338725-c49c-492c-8d0f-ba852665f703 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039599 Jul 31 20:08:38.639056 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 565/1122] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:08:38.915634 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e8be4cf3-49a9-46a2-ba82-b5c71e78edb6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:38.916231 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e8be4cf3-49a9-46a2-ba82-b5c71e78edb6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:38.923193 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8be4cf3-49a9-46a2-ba82-b5c71e78edb6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:38.923631 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8be4cf3-49a9-46a2-ba82-b5c71e78edb6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:38.924377 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8be4cf3-49a9-46a2-ba82-b5c71e78edb6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:38.924772 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8be4cf3-49a9-46a2-ba82-b5c71e78edb6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:38.956788 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8be4cf3-49a9-46a2-ba82-b5c71e78edb6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:38.957261 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8be4cf3-49a9-46a2-ba82-b5c71e78edb6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:38.957684 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-e8be4cf3-49a9-46a2-ba82-b5c71e78edb6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lazy-loading 'fault' on Instance uuid 750991ae-1a9e-41c2-a853-44e8ba64d53e {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:08:39.001458 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e8be4cf3-49a9-46a2-ba82-b5c71e78edb6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cc7039e64891af93ee67ee92ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe05c5b08d340efb6ecfc89d5bdcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:39.009454 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e8be4cf3-49a9-46a2-ba82-b5c71e78edb6 tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 200 len: 1304 microversion: 2.1 time: 0.100678 Jul 31 20:08:39.010040 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 558/1123] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:38 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:08:40.034133 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bdb7a9ff-b5a6-4f9d-85be-836428f05c9e tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:40.034849 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bdb7a9ff-b5a6-4f9d-85be-836428f05c9e tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] [instance: 750991ae-1a9e-41c2-a853-44e8ba64d53e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:40.042413 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bdb7a9ff-b5a6-4f9d-85be-836428f05c9e tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:40.042873 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bdb7a9ff-b5a6-4f9d-85be-836428f05c9e tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:40.043642 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bdb7a9ff-b5a6-4f9d-85be-836428f05c9e tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:40.044060 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bdb7a9ff-b5a6-4f9d-85be-836428f05c9e tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:40.058588 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-bdb7a9ff-b5a6-4f9d-85be-836428f05c9e tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] HTTP exception thrown: Instance 750991ae-1a9e-41c2-a853-44e8ba64d53e could not be found. Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bdb7a9ff-b5a6-4f9d-85be-836428f05c9e tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Request method failure captured: Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e HTTP/1.1 Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5uE15-2yWeA8LXAhNlV5BDAirI8YkHYyJAoM8gAPODQP4OK3d_qDico8wI-R9PBmbxu46jTv-X1y-E-IRYLg8KMYHW1lQkunnP92HBfBNbnB9qoWSO5iJ5JSZH_MhpeCYITg2tr-TjEVuDoQO16vhl-51cp5LsUYSwGWQMjyUOQ7oiM Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 9fe05c5b08d340efb6ecfc89d5bdcf17 Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-803422670 Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:08:40.060255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:08:40.061993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fe05c5b08d340efb6ecfc89d5bdcf17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fe05c5b08d340efb6ecfc89d5bdcf17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fe05c5b08d340efb6ecfc89d5bdcf17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fe05c5b08d340efb6ecfc89d5bdcf17"}]}] Jul 31 20:08:40.061993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-803422670 Jul 31 20:08:40.061993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 9fe05c5b08d340efb6ecfc89d5bdcf17 Jul 31 20:08:40.061993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-803422670 Jul 31 20:08:40.061993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-803422670-project Jul 31 20:08:40.061993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:08:40.061993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:08:40.061993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: ba40cc7039e64891af93ee67ee92ec9a Jul 31 20:08:40.061993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-803422670-project Jul 31 20:08:40.061993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:08:40.061993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance 750991ae-1a9e-41c2-a853-44e8ba64d53e could not be found. Jul 31 20:08:40.061993 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': '750991ae-1a9e-41c2-a853-44e8ba64d53e'} Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750991ae-1a9e-41c2-a853-44e8ba64d53e could not be found. Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:08:40.062950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750991ae-1a9e-41c2-a853-44e8ba64d53e could not be found. Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750991ae-1a9e-41c2-a853-44e8ba64d53e could not be found. Jul 31 20:08:40.064495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:08:40.066704 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bdb7a9ff-b5a6-4f9d-85be-836428f05c9e tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] Returning 404 to user: Instance 750991ae-1a9e-41c2-a853-44e8ba64d53e could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:08:40.066704 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bdb7a9ff-b5a6-4f9d-85be-836428f05c9e tempest-VolumesNegativeTest-803422670 tempest-VolumesNegativeTest-803422670-project] 10.222.0.48 "GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e" status: 404 len: 111 microversion: 2.1 time: 0.033363 Jul 31 20:08:40.066704 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 566/1124] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:40 2022] GET /compute/v2.1/servers/750991ae-1a9e-41c2-a853-44e8ba64d53e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:08:58.408259 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0db58871-b1be-4de0-9058-6143850a3c00 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:58.408802 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0db58871-b1be-4de0-9058-6143850a3c00 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:58.411113 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=5 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:58.411756 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=13 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:58.420071 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0db58871-b1be-4de0-9058-6143850a3c00 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:58.420546 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0db58871-b1be-4de0-9058-6143850a3c00 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:58.421353 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0db58871-b1be-4de0-9058-6143850a3c00 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:58.421786 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0db58871-b1be-4de0-9058-6143850a3c00 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:58.504935 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-0db58871-b1be-4de0-9058-6143850a3c00 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lazy-loading 'services' on Instance uuid bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:08:58.582395 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0db58871-b1be-4de0-9058-6143850a3c00 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d/os-volume_attachments/923f9e03-f281-454b-9b45-5983d4963955" status: 202 len: 0 microversion: 2.1 time: 0.178418 Jul 31 20:08:58.583050 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 559/1125] 10.222.0.48 () {58 vars in 1416 bytes} [Sun Jul 31 20:08:58 2022] DELETE /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d/os-volume_attachments/923f9e03-f281-454b-9b45-5983d4963955 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:08:59.703190 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bc34df7e-aeb3-48d7-a521-3be96e9aee0b tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:59.703728 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bc34df7e-aeb3-48d7-a521-3be96e9aee0b tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:59.706457 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:59.707083 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:08:59.713131 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc34df7e-aeb3-48d7-a521-3be96e9aee0b tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:59.713533 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc34df7e-aeb3-48d7-a521-3be96e9aee0b tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:59.714300 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc34df7e-aeb3-48d7-a521-3be96e9aee0b tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:59.714787 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc34df7e-aeb3-48d7-a521-3be96e9aee0b tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:59.740772 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bc34df7e-aeb3-48d7-a521-3be96e9aee0b tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:08:59.816241 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bc34df7e-aeb3-48d7-a521-3be96e9aee0b tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 204 len: 0 microversion: 2.1 time: 0.116791 Jul 31 20:08:59.816963 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 567/1126] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:08:59 2022] DELETE /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:08:59.826582 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-989f4c85-a332-491c-8130-cf9e57e9ba75 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:08:59.827710 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-989f4c85-a332-491c-8130-cf9e57e9ba75 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:08:59.834455 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-989f4c85-a332-491c-8130-cf9e57e9ba75 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:59.834900 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-989f4c85-a332-491c-8130-cf9e57e9ba75 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:59.835662 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-989f4c85-a332-491c-8130-cf9e57e9ba75 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:08:59.836112 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-989f4c85-a332-491c-8130-cf9e57e9ba75 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:08:59.969365 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-989f4c85-a332-491c-8130-cf9e57e9ba75 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:08:59.977088 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-989f4c85-a332-491c-8130-cf9e57e9ba75 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1513 microversion: 2.1 time: 0.154760 Jul 31 20:08:59.977696 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 560/1127] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:08:59 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:01.012950 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-590966c5-5971-41d6-afd2-e405691870ce tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:01.014124 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-590966c5-5971-41d6-afd2-e405691870ce tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:01.021659 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-590966c5-5971-41d6-afd2-e405691870ce tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:01.022097 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-590966c5-5971-41d6-afd2-e405691870ce tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:01.022854 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-590966c5-5971-41d6-afd2-e405691870ce tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:01.023275 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-590966c5-5971-41d6-afd2-e405691870ce tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:01.171873 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-590966c5-5971-41d6-afd2-e405691870ce tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:01.179886 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-590966c5-5971-41d6-afd2-e405691870ce tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1513 microversion: 2.1 time: 0.174035 Jul 31 20:09:01.180474 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 568/1128] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:01 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:02.197755 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-2ed60782-2c53-4664-b55a-4afa7c034f5a req-d8814897-6c4f-4e4f-b45b-bec00f4954ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d", "name": "network-vif-deleted", "tag": "6f2291ee-a544-4d8a-86c7-413a6ff44e29"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:09:02.203436 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce4398ca-b8a2-41b6-aa2b-f9397e86a06c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:02.204608 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce4398ca-b8a2-41b6-aa2b-f9397e86a06c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:02.211163 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-2ed60782-2c53-4664-b55a-4afa7c034f5a req-d8814897-6c4f-4e4f-b45b-bec00f4954ad service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:02.212223 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-2ed60782-2c53-4664-b55a-4afa7c034f5a req-d8814897-6c4f-4e4f-b45b-bec00f4954ad service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:02.214424 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce4398ca-b8a2-41b6-aa2b-f9397e86a06c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:02.214940 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce4398ca-b8a2-41b6-aa2b-f9397e86a06c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:02.215818 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce4398ca-b8a2-41b6-aa2b-f9397e86a06c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:02.216340 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce4398ca-b8a2-41b6-aa2b-f9397e86a06c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:02.235394 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-2ed60782-2c53-4664-b55a-4afa7c034f5a req-d8814897-6c4f-4e4f-b45b-bec00f4954ad service nova] Creating event network-vif-deleted:6f2291ee-a544-4d8a-86c7-413a6ff44e29 for instance bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d on hv-cinder-84984 Jul 31 20:09:02.243553 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-2ed60782-2c53-4664-b55a-4afa7c034f5a req-d8814897-6c4f-4e4f-b45b-bec00f4954ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049770 Jul 31 20:09:02.244158 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 561/1129] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:09:02.293706 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ce4398ca-b8a2-41b6-aa2b-f9397e86a06c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:02.301873 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ce4398ca-b8a2-41b6-aa2b-f9397e86a06c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1471 microversion: 2.1 time: 0.104929 Jul 31 20:09:02.302603 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 569/1130] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:02 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1471 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:02.429316 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7bd15908-c59c-447d-a1fc-a749aa8af221 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:02.429973 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7bd15908-c59c-447d-a1fc-a749aa8af221 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:02.430414 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-7ce3a764-42de-40d3-bdac-9c004811a276 req-b6f391ed-c5d2-4ab1-8b64-d4ad61fccff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642ca76f-9999-4d11-82d6-52e16c8f6207", "tag": "56de90d4-e582-4bc6-9afd-0a7a09dd281e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:09:02.436915 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bd15908-c59c-447d-a1fc-a749aa8af221 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:02.437457 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bd15908-c59c-447d-a1fc-a749aa8af221 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:02.438478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bd15908-c59c-447d-a1fc-a749aa8af221 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:02.439100 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bd15908-c59c-447d-a1fc-a749aa8af221 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:02.440414 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7ce3a764-42de-40d3-bdac-9c004811a276 req-b6f391ed-c5d2-4ab1-8b64-d4ad61fccff2 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:02.440848 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7ce3a764-42de-40d3-bdac-9c004811a276 req-b6f391ed-c5d2-4ab1-8b64-d4ad61fccff2 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:02.453249 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-7ce3a764-42de-40d3-bdac-9c004811a276 req-b6f391ed-c5d2-4ab1-8b64-d4ad61fccff2 service nova] Creating event network-changed:56de90d4-e582-4bc6-9afd-0a7a09dd281e for instance 642ca76f-9999-4d11-82d6-52e16c8f6207 on hv-cinder-84984 Jul 31 20:09:02.460077 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-7ce3a764-42de-40d3-bdac-9c004811a276 req-b6f391ed-c5d2-4ab1-8b64-d4ad61fccff2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033399 Jul 31 20:09:02.460846 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 570/1131] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 20:09:02.468812 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7bd15908-c59c-447d-a1fc-a749aa8af221 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:09:02.556880 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7bd15908-c59c-447d-a1fc-a749aa8af221 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "DELETE /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 204 len: 0 microversion: 2.1 time: 0.132218 Jul 31 20:09:02.557414 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 562/1132] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:09:02 2022] DELETE /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 20:09:02.566670 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-987408a1-055f-4979-b235-76635c40d7bb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:02.567392 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-987408a1-055f-4979-b235-76635c40d7bb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:02.574089 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-987408a1-055f-4979-b235-76635c40d7bb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:02.574558 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-987408a1-055f-4979-b235-76635c40d7bb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:02.575316 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-987408a1-055f-4979-b235-76635c40d7bb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:02.575746 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-987408a1-055f-4979-b235-76635c40d7bb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:02.718580 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-987408a1-055f-4979-b235-76635c40d7bb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:02.726820 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-987408a1-055f-4979-b235-76635c40d7bb tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1577 microversion: 2.1 time: 0.164814 Jul 31 20:09:02.727383 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 571/1133] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:02 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:09:03.324119 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bac8aa9f-f7bf-478f-8496-fa9e11bbd0e7 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:03.324825 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bac8aa9f-f7bf-478f-8496-fa9e11bbd0e7 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:03.332355 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bac8aa9f-f7bf-478f-8496-fa9e11bbd0e7 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:03.332805 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bac8aa9f-f7bf-478f-8496-fa9e11bbd0e7 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:03.333643 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bac8aa9f-f7bf-478f-8496-fa9e11bbd0e7 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:03.334082 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bac8aa9f-f7bf-478f-8496-fa9e11bbd0e7 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:03.368906 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bac8aa9f-f7bf-478f-8496-fa9e11bbd0e7 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:03.369473 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bac8aa9f-f7bf-478f-8496-fa9e11bbd0e7 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:03.369972 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-bac8aa9f-f7bf-478f-8496-fa9e11bbd0e7 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lazy-loading 'fault' on Instance uuid bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:09:03.416363 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bac8aa9f-f7bf-478f-8496-fa9e11bbd0e7 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:03.424811 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bac8aa9f-f7bf-478f-8496-fa9e11bbd0e7 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 200 len: 1308 microversion: 2.1 time: 0.104954 Jul 31 20:09:03.425338 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 563/1134] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:03 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:03.748261 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d1858b76-fa86-42ba-907d-0cbb7d9aa6d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:03.748960 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d1858b76-fa86-42ba-907d-0cbb7d9aa6d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:03.766219 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1858b76-fa86-42ba-907d-0cbb7d9aa6d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:03.766665 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1858b76-fa86-42ba-907d-0cbb7d9aa6d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:03.767458 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1858b76-fa86-42ba-907d-0cbb7d9aa6d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:03.767888 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1858b76-fa86-42ba-907d-0cbb7d9aa6d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:03.933373 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d1858b76-fa86-42ba-907d-0cbb7d9aa6d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:03.941288 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d1858b76-fa86-42ba-907d-0cbb7d9aa6d0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1577 microversion: 2.1 time: 0.197209 Jul 31 20:09:03.941828 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 572/1135] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:03 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:04.445426 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-934a2f1e-0903-4de9-a0f7-73ea4edf3a9d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:04.446035 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-934a2f1e-0903-4de9-a0f7-73ea4edf3a9d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:04.453016 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-934a2f1e-0903-4de9-a0f7-73ea4edf3a9d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:04.453559 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-934a2f1e-0903-4de9-a0f7-73ea4edf3a9d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:04.454327 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-934a2f1e-0903-4de9-a0f7-73ea4edf3a9d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:04.454752 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-934a2f1e-0903-4de9-a0f7-73ea4edf3a9d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:04.468793 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-934a2f1e-0903-4de9-a0f7-73ea4edf3a9d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] HTTP exception thrown: Instance bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d could not be found. Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-934a2f1e-0903-4de9-a0f7-73ea4edf3a9d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Request method failure captured: Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d HTTP/1.1 Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5uEkhpmpZi1lxlTMmwtaIhh7kN020cTKhousTEFc9YEzI-MsrA4nsyCtk9AMKSR1_B6bzzHhywvE2W7p-Auk64GzGEtbPfqfhuYPLYGpcj1KLCUGsgxa_kjgSvseNKeoc8dJWKe2fuf2uwpKqzEPHN43kCQTWJbqUXnYpUyn7p1ckjw Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 90341435be0e46008416d3afb9d9cf90 Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesSnapshotTestJSON-698827392 Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:09:04.470485 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:09:04.472149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/90341435be0e46008416d3afb9d9cf90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/90341435be0e46008416d3afb9d9cf90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_90341435be0e46008416d3afb9d9cf90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/90341435be0e46008416d3afb9d9cf90"}]}] Jul 31 20:09:04.472149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesSnapshotTestJSON-698827392 Jul 31 20:09:04.472149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 90341435be0e46008416d3afb9d9cf90 Jul 31 20:09:04.472149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-698827392 Jul 31 20:09:04.472149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesSnapshotTestJSON-698827392-project Jul 31 20:09:04.472149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:09:04.472149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:09:04.472149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: 1e943453c5734f99bce435117e202b8e Jul 31 20:09:04.472149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesSnapshotTestJSON-698827392-project Jul 31 20:09:04.472149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:09:04.472149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d could not be found. Jul 31 20:09:04.472149 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': 'bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d'} Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d could not be found. Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:09:04.473130 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d could not be found. Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d could not be found. Jul 31 20:09:04.474833 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:04.476027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-934a2f1e-0903-4de9-a0f7-73ea4edf3a9d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Returning 404 to user: Instance bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:09:04.476027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-934a2f1e-0903-4de9-a0f7-73ea4edf3a9d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d" status: 404 len: 111 microversion: 2.1 time: 0.030422 Jul 31 20:09:04.476027 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 564/1136] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:04 2022] GET /compute/v2.1/servers/bb43bdab-1d9e-4f3c-ac63-afd3ceb9c10d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:09:04.902110 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-053cdec4-15de-48de-b76a-c1b3409b2773 req-84a12692-dfce-4982-9c74-d6b805d054f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "642ca76f-9999-4d11-82d6-52e16c8f6207", "name": "network-vif-deleted", "tag": "56de90d4-e582-4bc6-9afd-0a7a09dd281e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:09:04.911811 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-053cdec4-15de-48de-b76a-c1b3409b2773 req-84a12692-dfce-4982-9c74-d6b805d054f5 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:04.912244 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-053cdec4-15de-48de-b76a-c1b3409b2773 req-84a12692-dfce-4982-9c74-d6b805d054f5 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:04.923151 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-053cdec4-15de-48de-b76a-c1b3409b2773 req-84a12692-dfce-4982-9c74-d6b805d054f5 service nova] Creating event network-vif-deleted:56de90d4-e582-4bc6-9afd-0a7a09dd281e for instance 642ca76f-9999-4d11-82d6-52e16c8f6207 on hv-cinder-84984 Jul 31 20:09:04.927961 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-053cdec4-15de-48de-b76a-c1b3409b2773 req-84a12692-dfce-4982-9c74-d6b805d054f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030152 Jul 31 20:09:04.928522 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 573/1137] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:09:04.962926 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5e55ca11-c175-4e9a-be10-37ca26794970 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:04.963565 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5e55ca11-c175-4e9a-be10-37ca26794970 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:04.970296 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e55ca11-c175-4e9a-be10-37ca26794970 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:04.970742 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e55ca11-c175-4e9a-be10-37ca26794970 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:04.971521 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e55ca11-c175-4e9a-be10-37ca26794970 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:04.971956 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e55ca11-c175-4e9a-be10-37ca26794970 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:05.040576 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5e55ca11-c175-4e9a-be10-37ca26794970 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:05.049896 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5e55ca11-c175-4e9a-be10-37ca26794970 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1390 microversion: 2.1 time: 0.090463 Jul 31 20:09:05.050642 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 565/1138] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:04 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:06.076723 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5ba0567d-b098-4ebc-a24e-d06a62067838 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:06.077499 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5ba0567d-b098-4ebc-a24e-d06a62067838 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:06.083886 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ba0567d-b098-4ebc-a24e-d06a62067838 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:06.084327 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ba0567d-b098-4ebc-a24e-d06a62067838 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:06.085081 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ba0567d-b098-4ebc-a24e-d06a62067838 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:06.085528 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ba0567d-b098-4ebc-a24e-d06a62067838 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:06.150254 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5ba0567d-b098-4ebc-a24e-d06a62067838 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:06.157983 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5ba0567d-b098-4ebc-a24e-d06a62067838 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1390 microversion: 2.1 time: 0.086056 Jul 31 20:09:06.158539 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 574/1139] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:06 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:07.183334 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-48f9cdff-6e50-48d1-8236-03096064059c tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:07.184319 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-48f9cdff-6e50-48d1-8236-03096064059c tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:07.194949 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48f9cdff-6e50-48d1-8236-03096064059c tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:07.195686 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48f9cdff-6e50-48d1-8236-03096064059c tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:07.196920 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48f9cdff-6e50-48d1-8236-03096064059c tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:07.197669 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48f9cdff-6e50-48d1-8236-03096064059c tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:07.262977 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-48f9cdff-6e50-48d1-8236-03096064059c tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:07.270908 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-48f9cdff-6e50-48d1-8236-03096064059c tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1225 microversion: 2.1 time: 0.094103 Jul 31 20:09:07.271511 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 566/1140] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:07 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:08.292335 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c292c0b4-0679-4e57-99d9-1adfb13f34d6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:08.292916 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c292c0b4-0679-4e57-99d9-1adfb13f34d6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:08.299573 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c292c0b4-0679-4e57-99d9-1adfb13f34d6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:08.300025 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c292c0b4-0679-4e57-99d9-1adfb13f34d6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:08.300794 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c292c0b4-0679-4e57-99d9-1adfb13f34d6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:08.301344 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c292c0b4-0679-4e57-99d9-1adfb13f34d6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:08.365359 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c292c0b4-0679-4e57-99d9-1adfb13f34d6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:08.373885 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c292c0b4-0679-4e57-99d9-1adfb13f34d6 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 200 len: 1225 microversion: 2.1 time: 0.085456 Jul 31 20:09:08.374521 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 575/1141] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:08 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:09.398492 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c7ab5fdc-edda-4e02-86a0-f706439c190a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:09.399431 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c7ab5fdc-edda-4e02-86a0-f706439c190a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: 642ca76f-9999-4d11-82d6-52e16c8f6207] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:09.410803 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7ab5fdc-edda-4e02-86a0-f706439c190a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:09.411551 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7ab5fdc-edda-4e02-86a0-f706439c190a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:09.412793 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7ab5fdc-edda-4e02-86a0-f706439c190a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:09.413553 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7ab5fdc-edda-4e02-86a0-f706439c190a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:09.430178 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-c7ab5fdc-edda-4e02-86a0-f706439c190a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] HTTP exception thrown: Instance 642ca76f-9999-4d11-82d6-52e16c8f6207 could not be found. Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c7ab5fdc-edda-4e02-86a0-f706439c190a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Request method failure captured: Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 HTTP/1.1 Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t-Bns-4hAHAbfhfpj7j--iszqblES_2VUdesanw1Z6iz3LUz2zrcgvxVeA23Z-Ka-VZWwRwtHsqnwF9vymxT-tIgvnFbi4SPE2zoserw-43sGnIfK4AoFi-zjvqgMeD2QjKyRNJ2nyoA3NXo2Aavqz-P9usIMCjD_AIczLAZ3NKELg Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 15e426e0b2bd4bc29e7a8e222fcc8f7e Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestVolumeBootPattern-366523324 Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:09:09.431685 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:09:09.433310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}] Jul 31 20:09:09.433310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestVolumeBootPattern-366523324 Jul 31 20:09:09.433310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 15e426e0b2bd4bc29e7a8e222fcc8f7e Jul 31 20:09:09.433310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestVolumeBootPattern-366523324 Jul 31 20:09:09.433310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-TestVolumeBootPattern-366523324-project Jul 31 20:09:09.433310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:09:09.433310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:09:09.433310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: c6d7c6c7a3b5413c9c8d5c1e69d9db4c Jul 31 20:09:09.433310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestVolumeBootPattern-366523324-project Jul 31 20:09:09.433310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:09:09.433310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance 642ca76f-9999-4d11-82d6-52e16c8f6207 could not be found. Jul 31 20:09:09.433310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': '642ca76f-9999-4d11-82d6-52e16c8f6207'} Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 642ca76f-9999-4d11-82d6-52e16c8f6207 could not be found. Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:09:09.434255 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 642ca76f-9999-4d11-82d6-52e16c8f6207 could not be found. Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 642ca76f-9999-4d11-82d6-52e16c8f6207 could not be found. Jul 31 20:09:09.435780 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:09.437257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c7ab5fdc-edda-4e02-86a0-f706439c190a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Returning 404 to user: Instance 642ca76f-9999-4d11-82d6-52e16c8f6207 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:09:09.437257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c7ab5fdc-edda-4e02-86a0-f706439c190a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207" status: 404 len: 111 microversion: 2.1 time: 0.041069 Jul 31 20:09:09.437257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 567/1142] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:09 2022] GET /compute/v2.1/servers/642ca76f-9999-4d11-82d6-52e16c8f6207 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:09:14.454190 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-910114849", "imageRef": "bdf43e4e-d485-4ac4-b2f0-f83c4e105861", "flavorRef": "452", "networks": [{"uuid": "6ad1e1ec-553c-4a12-a4b9-27cfdf170446"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:09:14.508616 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] validate_networks() for [('6ad1e1ec-553c-4a12-a4b9-27cfdf170446', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 20:09:14.642413 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e35eac58-e586-4038-bc45-97b43878175f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:14.643032 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e35eac58-e586-4038-bc45-97b43878175f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:14.650592 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e35eac58-e586-4038-bc45-97b43878175f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:14.651140 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e35eac58-e586-4038-bc45-97b43878175f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:14.652017 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e35eac58-e586-4038-bc45-97b43878175f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:14.652535 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e35eac58-e586-4038-bc45-97b43878175f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:14.680655 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e35eac58-e586-4038-bc45-97b43878175f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:09:14.774267 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e35eac58-e586-4038-bc45-97b43878175f tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 204 len: 0 microversion: 2.1 time: 0.135686 Jul 31 20:09:14.778422 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 568/1143] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:09:14 2022] DELETE /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 20:09:14.782354 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-d852fe88-4116-4008-9a63-1d8526934fbc req-c0d08fef-7bf2-4e89-915b-bde74ae02ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6903e84-ecc4-4445-9058-df88ae4f3d2f", "tag": "5acf938b-5d35-458d-9e0d-0c6a46fac38e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:09:14.798716 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d852fe88-4116-4008-9a63-1d8526934fbc req-c0d08fef-7bf2-4e89-915b-bde74ae02ceb service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:14.799226 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d852fe88-4116-4008-9a63-1d8526934fbc req-c0d08fef-7bf2-4e89-915b-bde74ae02ceb service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:14.812819 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-d852fe88-4116-4008-9a63-1d8526934fbc req-c0d08fef-7bf2-4e89-915b-bde74ae02ceb service nova] Creating event network-changed:5acf938b-5d35-458d-9e0d-0c6a46fac38e for instance c6903e84-ecc4-4445-9058-df88ae4f3d2f on hv-cinder-84984 Jul 31 20:09:14.818949 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-d852fe88-4116-4008-9a63-1d8526934fbc req-c0d08fef-7bf2-4e89-915b-bde74ae02ceb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042017 Jul 31 20:09:14.819810 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 569/1144] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:09:14.825476 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-49ff8c46-4aa4-4576-bb9c-51794b109b69 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:14.826230 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-49ff8c46-4aa4-4576-bb9c-51794b109b69 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:14.832540 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-49ff8c46-4aa4-4576-bb9c-51794b109b69 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:14.833067 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-49ff8c46-4aa4-4576-bb9c-51794b109b69 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:14.833938 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-49ff8c46-4aa4-4576-bb9c-51794b109b69 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:14.834438 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-49ff8c46-4aa4-4576-bb9c-51794b109b69 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:14.919517 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 20:09:14.919935 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 20:09:14.920399 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 20:09:14.920795 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 20:09:14.921278 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 20:09:14.931120 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:14.931551 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:14.932358 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:14.932952 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:14.952093 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Getting quotas for project 90341435be0e46008416d3afb9d9cf90. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 20:09:14.957187 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Getting quotas for user 1e943453c5734f99bce435117e202b8e and project 90341435be0e46008416d3afb9d9cf90. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 20:09:14.968501 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 20:09:14.970822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bdf43e4e-d485-4ac4-b2f0-f83c4e105861',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 20:09:14.990153 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-49ff8c46-4aa4-4576-bb9c-51794b109b69 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:14.998572 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-49ff8c46-4aa4-4576-bb9c-51794b109b69 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1577 microversion: 2.1 time: 0.177739 Jul 31 20:09:14.999196 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 570/1145] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:14 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:15.018471 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-50bee3a0-2d46-4412-a444-8fe734ff058c tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568256 Jul 31 20:09:15.025057 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 576/1146] 10.222.0.48 () {60 vars in 1147 bytes} [Sun Jul 31 20:09:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 20:09:15.030579 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3c9fffca-1468-4418-b873-018172bd486a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:15.031237 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3c9fffca-1468-4418-b873-018172bd486a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:15.095167 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3c9fffca-1468-4418-b873-018172bd486a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:15.106981 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3c9fffca-1468-4418-b873-018172bd486a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 200 len: 1218 microversion: 2.1 time: 0.080506 Jul 31 20:09:15.108681 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 571/1147] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:15 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:09:16.019774 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ee6a63e8-6860-462c-8a55-cf711cf4954a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:16.020524 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ee6a63e8-6860-462c-8a55-cf711cf4954a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:16.027347 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee6a63e8-6860-462c-8a55-cf711cf4954a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:16.027795 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee6a63e8-6860-462c-8a55-cf711cf4954a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:16.028578 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee6a63e8-6860-462c-8a55-cf711cf4954a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:16.029014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee6a63e8-6860-462c-8a55-cf711cf4954a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:16.129096 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8ec649a5-7975-442d-af2a-9fc95f532a11 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:16.130358 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8ec649a5-7975-442d-af2a-9fc95f532a11 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:16.138061 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ec649a5-7975-442d-af2a-9fc95f532a11 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:16.138506 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ec649a5-7975-442d-af2a-9fc95f532a11 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:16.139280 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ec649a5-7975-442d-af2a-9fc95f532a11 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:16.139947 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ec649a5-7975-442d-af2a-9fc95f532a11 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:16.201979 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ee6a63e8-6860-462c-8a55-cf711cf4954a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:16.211175 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ee6a63e8-6860-462c-8a55-cf711cf4954a tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1577 microversion: 2.1 time: 0.195486 Jul 31 20:09:16.211816 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 577/1148] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:16 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1577 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 20:09:16.217824 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8ec649a5-7975-442d-af2a-9fc95f532a11 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:16.225299 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8ec649a5-7975-442d-af2a-9fc95f532a11 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 200 len: 1214 microversion: 2.1 time: 0.100166 Jul 31 20:09:16.225860 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 572/1149] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:16 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:17.231944 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f551a671-4c86-4f5a-8a3a-c9f6f5294183 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:17.232515 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f551a671-4c86-4f5a-8a3a-c9f6f5294183 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:17.240106 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f551a671-4c86-4f5a-8a3a-c9f6f5294183 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:17.240525 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f551a671-4c86-4f5a-8a3a-c9f6f5294183 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:17.241530 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f551a671-4c86-4f5a-8a3a-c9f6f5294183 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:17.241759 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f551a671-4c86-4f5a-8a3a-c9f6f5294183 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:17.247343 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8c4c8b5c-5656-4b6c-8c79-91ad3a689b60 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:17.248238 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8c4c8b5c-5656-4b6c-8c79-91ad3a689b60 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:17.255478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c4c8b5c-5656-4b6c-8c79-91ad3a689b60 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:17.256247 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c4c8b5c-5656-4b6c-8c79-91ad3a689b60 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:17.257306 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c4c8b5c-5656-4b6c-8c79-91ad3a689b60 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:17.257800 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c4c8b5c-5656-4b6c-8c79-91ad3a689b60 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:17.395769 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8c4c8b5c-5656-4b6c-8c79-91ad3a689b60 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:17.403549 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8c4c8b5c-5656-4b6c-8c79-91ad3a689b60 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 200 len: 1276 microversion: 2.1 time: 0.160568 Jul 31 20:09:17.404120 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 573/1150] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:17 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:17.634350 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f551a671-4c86-4f5a-8a3a-c9f6f5294183 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:17.642761 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f551a671-4c86-4f5a-8a3a-c9f6f5294183 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1577 microversion: 2.1 time: 0.414835 Jul 31 20:09:17.643339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 578/1151] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:17 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1577 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:18.062310 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-d6ddf896-b97b-4ed8-ae59-38ddb66600fa req-ecf08e01-0fb2-4375-aef6-ec990f77c4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6903e84-ecc4-4445-9058-df88ae4f3d2f", "name": "network-vif-deleted", "tag": "5acf938b-5d35-458d-9e0d-0c6a46fac38e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:09:18.073576 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d6ddf896-b97b-4ed8-ae59-38ddb66600fa req-ecf08e01-0fb2-4375-aef6-ec990f77c4b1 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:18.074254 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d6ddf896-b97b-4ed8-ae59-38ddb66600fa req-ecf08e01-0fb2-4375-aef6-ec990f77c4b1 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:18.087089 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-d6ddf896-b97b-4ed8-ae59-38ddb66600fa req-ecf08e01-0fb2-4375-aef6-ec990f77c4b1 service nova] Creating event network-vif-deleted:5acf938b-5d35-458d-9e0d-0c6a46fac38e for instance c6903e84-ecc4-4445-9058-df88ae4f3d2f on hv-cinder-84984 Jul 31 20:09:18.092625 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-d6ddf896-b97b-4ed8-ae59-38ddb66600fa req-ecf08e01-0fb2-4375-aef6-ec990f77c4b1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034882 Jul 31 20:09:18.093971 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 574/1152] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:09:18.424990 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-07a6065f-c435-4466-b660-f6c74ef12c91 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:18.425863 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-07a6065f-c435-4466-b660-f6c74ef12c91 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:18.433308 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07a6065f-c435-4466-b660-f6c74ef12c91 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:18.433822 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07a6065f-c435-4466-b660-f6c74ef12c91 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:18.434667 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07a6065f-c435-4466-b660-f6c74ef12c91 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:18.435118 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07a6065f-c435-4466-b660-f6c74ef12c91 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:18.665285 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c1b01419-e433-4b2e-9790-edaf08a3ff9e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:18.665899 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c1b01419-e433-4b2e-9790-edaf08a3ff9e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:18.672729 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1b01419-e433-4b2e-9790-edaf08a3ff9e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:18.673183 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1b01419-e433-4b2e-9790-edaf08a3ff9e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:18.673951 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1b01419-e433-4b2e-9790-edaf08a3ff9e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:18.674383 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1b01419-e433-4b2e-9790-edaf08a3ff9e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:18.692974 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:09:18.697765 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-07a6065f-c435-4466-b660-f6c74ef12c91 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:18.705921 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-07a6065f-c435-4466-b660-f6c74ef12c91 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 200 len: 1318 microversion: 2.1 time: 0.285791 Jul 31 20:09:18.707428 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 579/1153] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:18 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:18.715692 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1b01419-e433-4b2e-9790-edaf08a3ff9e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:18.716110 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1b01419-e433-4b2e-9790-edaf08a3ff9e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:18.716922 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-c1b01419-e433-4b2e-9790-edaf08a3ff9e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lazy-loading 'fault' on Instance uuid c6903e84-ecc4-4445-9058-df88ae4f3d2f {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:09:18.766681 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c1b01419-e433-4b2e-9790-edaf08a3ff9e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d7c6c7a3b5413c9c8d5c1e69d9db4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e426e0b2bd4bc29e7a8e222fcc8f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:18.775207 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c1b01419-e433-4b2e-9790-edaf08a3ff9e tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 200 len: 1231 microversion: 2.1 time: 0.114775 Jul 31 20:09:18.775844 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 575/1154] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:18 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 1231 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:19.731838 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-550aa68d-c97f-4fea-b8ec-4b6bbdc62de2 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:19.732726 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-550aa68d-c97f-4fea-b8ec-4b6bbdc62de2 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:19.740398 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-550aa68d-c97f-4fea-b8ec-4b6bbdc62de2 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:19.740867 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-550aa68d-c97f-4fea-b8ec-4b6bbdc62de2 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:19.741681 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-550aa68d-c97f-4fea-b8ec-4b6bbdc62de2 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:19.742128 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-550aa68d-c97f-4fea-b8ec-4b6bbdc62de2 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:19.796083 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4a5e1c01-8ff7-45e4-a56a-e9426ea9f9a9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:19.796728 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4a5e1c01-8ff7-45e4-a56a-e9426ea9f9a9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c6903e84-ecc4-4445-9058-df88ae4f3d2f] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:19.803751 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a5e1c01-8ff7-45e4-a56a-e9426ea9f9a9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:19.804196 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a5e1c01-8ff7-45e4-a56a-e9426ea9f9a9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:19.804962 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a5e1c01-8ff7-45e4-a56a-e9426ea9f9a9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:19.805443 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a5e1c01-8ff7-45e4-a56a-e9426ea9f9a9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:19.819430 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-4a5e1c01-8ff7-45e4-a56a-e9426ea9f9a9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] HTTP exception thrown: Instance c6903e84-ecc4-4445-9058-df88ae4f3d2f could not be found. Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4a5e1c01-8ff7-45e4-a56a-e9426ea9f9a9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Request method failure captured: Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f HTTP/1.1 Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t-Bns-4hAHAbfhfpj7j--iszqblES_2VUdesanw1Z6iz3LUz2zrcgvxVeA23Z-Ka-VZWwRwtHsqnwF9vymxT-tIgvnFbi4SPE2zoserw-43sGnIfK4AoFi-zjvqgMeD2QjKyRNJ2nyoA3NXo2Aavqz-P9usIMCjD_AIczLAZ3NKELg Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 15e426e0b2bd4bc29e7a8e222fcc8f7e Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestVolumeBootPattern-366523324 Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:09:19.821279 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:09:19.822929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}] Jul 31 20:09:19.822929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestVolumeBootPattern-366523324 Jul 31 20:09:19.822929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 15e426e0b2bd4bc29e7a8e222fcc8f7e Jul 31 20:09:19.822929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestVolumeBootPattern-366523324 Jul 31 20:09:19.822929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-TestVolumeBootPattern-366523324-project Jul 31 20:09:19.822929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:09:19.822929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:09:19.822929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: c6d7c6c7a3b5413c9c8d5c1e69d9db4c Jul 31 20:09:19.822929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestVolumeBootPattern-366523324-project Jul 31 20:09:19.822929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:09:19.822929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance c6903e84-ecc4-4445-9058-df88ae4f3d2f could not be found. Jul 31 20:09:19.822929 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': 'c6903e84-ecc4-4445-9058-df88ae4f3d2f'} Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6903e84-ecc4-4445-9058-df88ae4f3d2f could not be found. Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:09:19.823992 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6903e84-ecc4-4445-9058-df88ae4f3d2f could not be found. Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6903e84-ecc4-4445-9058-df88ae4f3d2f could not be found. Jul 31 20:09:19.825591 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:19.826960 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4a5e1c01-8ff7-45e4-a56a-e9426ea9f9a9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Returning 404 to user: Instance c6903e84-ecc4-4445-9058-df88ae4f3d2f could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:09:19.826960 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4a5e1c01-8ff7-45e4-a56a-e9426ea9f9a9 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f" status: 404 len: 111 microversion: 2.1 time: 0.030573 Jul 31 20:09:19.826960 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 576/1155] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:19 2022] GET /compute/v2.1/servers/c6903e84-ecc4-4445-9058-df88ae4f3d2f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:09:19.880290 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-550aa68d-c97f-4fea-b8ec-4b6bbdc62de2 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:19.887912 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-550aa68d-c97f-4fea-b8ec-4b6bbdc62de2 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 200 len: 1318 microversion: 2.1 time: 0.162912 Jul 31 20:09:19.888551 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 580/1156] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:19 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:20.117426 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-145fd0b0-fc57-4bf4-9d09-e04fdc5a5ed2 req-c0fe395a-39e7-43a8-8b0b-d1c2c9276d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c12684-359d-4e14-8739-ea462be99862", "tag": "590e25b3-f2cb-434c-a84f-5bccc9821924"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:09:20.127517 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-145fd0b0-fc57-4bf4-9d09-e04fdc5a5ed2 req-c0fe395a-39e7-43a8-8b0b-d1c2c9276d65 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:20.127996 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-145fd0b0-fc57-4bf4-9d09-e04fdc5a5ed2 req-c0fe395a-39e7-43a8-8b0b-d1c2c9276d65 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:20.141943 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-145fd0b0-fc57-4bf4-9d09-e04fdc5a5ed2 req-c0fe395a-39e7-43a8-8b0b-d1c2c9276d65 service nova] Creating event network-changed:590e25b3-f2cb-434c-a84f-5bccc9821924 for instance d1c12684-359d-4e14-8739-ea462be99862 on hv-cinder-84984 Jul 31 20:09:20.147281 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-145fd0b0-fc57-4bf4-9d09-e04fdc5a5ed2 req-c0fe395a-39e7-43a8-8b0b-d1c2c9276d65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033691 Jul 31 20:09:20.148002 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 577/1157] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:09:20.286052 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0fc90f11-bd6b-404e-a469-384f5d7480b0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:20.286550 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0fc90f11-bd6b-404e-a469-384f5d7480b0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:20.292955 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fc90f11-bd6b-404e-a469-384f5d7480b0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:20.293434 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fc90f11-bd6b-404e-a469-384f5d7480b0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:20.294196 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fc90f11-bd6b-404e-a469-384f5d7480b0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:20.294628 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fc90f11-bd6b-404e-a469-384f5d7480b0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:20.308255 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-0fc90f11-bd6b-404e-a469-384f5d7480b0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] HTTP exception thrown: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0fc90f11-bd6b-404e-a469-384f5d7480b0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Request method failure captured: Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 HTTP/1.1 Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5t-Bns-4hAHAbfhfpj7j--iszqblES_2VUdesanw1Z6iz3LUz2zrcgvxVeA23Z-Ka-VZWwRwtHsqnwF9vymxT-tIgvnFbi4SPE2zoserw-43sGnIfK4AoFi-zjvqgMeD2QjKyRNJ2nyoA3NXo2Aavqz-P9usIMCjD_AIczLAZ3NKELg Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 15e426e0b2bd4bc29e7a8e222fcc8f7e Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-366523324 Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:09:20.310014 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:09:20.311618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}] Jul 31 20:09:20.311618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-366523324 Jul 31 20:09:20.311618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 15e426e0b2bd4bc29e7a8e222fcc8f7e Jul 31 20:09:20.311618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-366523324 Jul 31 20:09:20.311618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-366523324-project Jul 31 20:09:20.311618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:09:20.311618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:09:20.311618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: c6d7c6c7a3b5413c9c8d5c1e69d9db4c Jul 31 20:09:20.311618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-366523324-project Jul 31 20:09:20.311618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:09:20.311618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:09:20.311618 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': 'c0dc439c-b3b3-443c-8680-f7b1623dbe29'} Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:09:20.312750 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:09:20.314355 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:09:20.316038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0fc90f11-bd6b-404e-a469-384f5d7480b0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Returning 404 to user: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:09:20.316038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0fc90f11-bd6b-404e-a469-384f5d7480b0 tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 404 len: 111 microversion: 2.1 time: 0.029320 Jul 31 20:09:20.316038 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 581/1158] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:09:20 2022] DELETE /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:09:20.322982 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b92374fe-ae4b-4d08-862d-cd80a25bb9dd tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:20.323755 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b92374fe-ae4b-4d08-862d-cd80a25bb9dd tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] [instance: c0dc439c-b3b3-443c-8680-f7b1623dbe29] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:20.330122 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b92374fe-ae4b-4d08-862d-cd80a25bb9dd tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:20.330563 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b92374fe-ae4b-4d08-862d-cd80a25bb9dd tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:20.331311 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b92374fe-ae4b-4d08-862d-cd80a25bb9dd tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:20.331736 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b92374fe-ae4b-4d08-862d-cd80a25bb9dd tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:20.346054 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-b92374fe-ae4b-4d08-862d-cd80a25bb9dd tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] HTTP exception thrown: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b92374fe-ae4b-4d08-862d-cd80a25bb9dd tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Request method failure captured: Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 HTTP/1.1 Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Connection: close Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Host: 10.222.0.48 Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi5t-Bns-4hAHAbfhfpj7j--iszqblES_2VUdesanw1Z6iz3LUz2zrcgvxVeA23Z-Ka-VZWwRwtHsqnwF9vymxT-tIgvnFbi4SPE2zoserw-43sGnIfK4AoFi-zjvqgMeD2QjKyRNJ2nyoA3NXo2Aavqz-P9usIMCjD_AIczLAZ3NKELg Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Id: 15e426e0b2bd4bc29e7a8e222fcc8f7e Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestVolumeBootPattern-366523324 Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 31 20:09:20.348272 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 31 20:09:20.349942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/15e426e0b2bd4bc29e7a8e222fcc8f7e"}]}] Jul 31 20:09:20.349942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestVolumeBootPattern-366523324 Jul 31 20:09:20.349942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 15e426e0b2bd4bc29e7a8e222fcc8f7e Jul 31 20:09:20.349942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestVolumeBootPattern-366523324 Jul 31 20:09:20.349942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User: tempest-TestVolumeBootPattern-366523324-project Jul 31 20:09:20.349942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 31 20:09:20.349942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 31 20:09:20.349942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Id: c6d7c6c7a3b5413c9c8d5c1e69d9db4c Jul 31 20:09:20.349942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestVolumeBootPattern-366523324-project Jul 31 20:09:20.349942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: method: > Jul 31 20:09:20.349942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: exception: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:09:20.349942 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: action_args: {'id': 'c0dc439c-b3b3-443c-8680-f7b1623dbe29'} Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:09:20.350820 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. Jul 31 20:09:20.352264 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 31 20:09:20.354257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b92374fe-ae4b-4d08-862d-cd80a25bb9dd tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Returning 404 to user: Instance c0dc439c-b3b3-443c-8680-f7b1623dbe29 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:09:20.354257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b92374fe-ae4b-4d08-862d-cd80a25bb9dd tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29" status: 404 len: 111 microversion: 2.1 time: 0.031379 Jul 31 20:09:20.354257 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 578/1159] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:20 2022] GET /compute/v2.1/servers/c0dc439c-b3b3-443c-8680-f7b1623dbe29 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:09:20.909132 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-641457ff-c9b3-45d4-b072-e882c895c150 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:20.909742 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-641457ff-c9b3-45d4-b072-e882c895c150 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:20.916492 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-641457ff-c9b3-45d4-b072-e882c895c150 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:20.916927 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-641457ff-c9b3-45d4-b072-e882c895c150 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:20.917720 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-641457ff-c9b3-45d4-b072-e882c895c150 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:20.918145 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-641457ff-c9b3-45d4-b072-e882c895c150 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:21.049335 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-641457ff-c9b3-45d4-b072-e882c895c150 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:21.057185 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-641457ff-c9b3-45d4-b072-e882c895c150 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 200 len: 1318 microversion: 2.1 time: 0.152162 Jul 31 20:09:21.057756 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 582/1160] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:20 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:21.674961 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bf33b050-d377-4800-9697-fb98f6fca1aa tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] Calling method '.version_select at 0x7ffa248d7670>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:21.700566 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bf33b050-d377-4800-9697-fb98f6fca1aa tempest-TestVolumeBootPattern-366523324 tempest-TestVolumeBootPattern-366523324-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1052386514" status: 202 len: 0 microversion: 2.1 time: 0.029279 Jul 31 20:09:21.701118 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 579/1161] 10.222.0.48 () {58 vars in 1263 bytes} [Sun Jul 31 20:09:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1052386514 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:09:22.078265 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a9d50401-7574-4f41-9eb8-6c189c409f0d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:22.078879 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a9d50401-7574-4f41-9eb8-6c189c409f0d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:22.085784 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9d50401-7574-4f41-9eb8-6c189c409f0d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:22.086227 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9d50401-7574-4f41-9eb8-6c189c409f0d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:22.087005 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9d50401-7574-4f41-9eb8-6c189c409f0d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:22.087426 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9d50401-7574-4f41-9eb8-6c189c409f0d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:22.232923 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a9d50401-7574-4f41-9eb8-6c189c409f0d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:22.242677 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a9d50401-7574-4f41-9eb8-6c189c409f0d tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 200 len: 1318 microversion: 2.1 time: 0.168301 Jul 31 20:09:22.243520 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 583/1162] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:22 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:23.264793 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d25385b9-0247-47e4-a0b3-b590ea522f28 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:23.265391 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d25385b9-0247-47e4-a0b3-b590ea522f28 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:23.272579 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d25385b9-0247-47e4-a0b3-b590ea522f28 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:23.273025 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d25385b9-0247-47e4-a0b3-b590ea522f28 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:23.273821 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d25385b9-0247-47e4-a0b3-b590ea522f28 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:23.274249 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d25385b9-0247-47e4-a0b3-b590ea522f28 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:23.410618 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d25385b9-0247-47e4-a0b3-b590ea522f28 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:23.417979 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d25385b9-0247-47e4-a0b3-b590ea522f28 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 200 len: 1318 microversion: 2.1 time: 0.157531 Jul 31 20:09:23.418811 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 580/1163] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:23 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:24.004887 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-4bcb9292-15f9-43cd-8d91-7bd829176181 req-cec99abb-f728-4697-a0b0-6a5a71452c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c12684-359d-4e14-8739-ea462be99862", "name": "network-vif-plugged", "status": "completed", "tag": "590e25b3-f2cb-434c-a84f-5bccc9821924"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:09:24.018919 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4bcb9292-15f9-43cd-8d91-7bd829176181 req-cec99abb-f728-4697-a0b0-6a5a71452c8a service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:24.019467 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4bcb9292-15f9-43cd-8d91-7bd829176181 req-cec99abb-f728-4697-a0b0-6a5a71452c8a service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:24.039709 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-4bcb9292-15f9-43cd-8d91-7bd829176181 req-cec99abb-f728-4697-a0b0-6a5a71452c8a service nova] Creating event network-vif-plugged:590e25b3-f2cb-434c-a84f-5bccc9821924 for instance d1c12684-359d-4e14-8739-ea462be99862 on hv-cinder-84984 Jul 31 20:09:24.046110 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-4bcb9292-15f9-43cd-8d91-7bd829176181 req-cec99abb-f728-4697-a0b0-6a5a71452c8a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051002 Jul 31 20:09:24.047319 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 584/1164] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:09:24.439997 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9695e959-3a33-4a8b-a282-f41fcd9a1677 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:24.441045 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9695e959-3a33-4a8b-a282-f41fcd9a1677 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:24.448512 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9695e959-3a33-4a8b-a282-f41fcd9a1677 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:24.449091 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9695e959-3a33-4a8b-a282-f41fcd9a1677 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:24.450197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9695e959-3a33-4a8b-a282-f41fcd9a1677 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:24.450892 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9695e959-3a33-4a8b-a282-f41fcd9a1677 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:24.664038 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9695e959-3a33-4a8b-a282-f41fcd9a1677 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:24.672005 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9695e959-3a33-4a8b-a282-f41fcd9a1677 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 200 len: 1318 microversion: 2.1 time: 0.236477 Jul 31 20:09:24.672576 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 581/1165] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:24 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:25.690422 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:09:25.691999 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:09:25.697673 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eede41d3-6584-49e1-be9c-a89c090ed043 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:25.698630 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eede41d3-6584-49e1-be9c-a89c090ed043 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:25.707597 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eede41d3-6584-49e1-be9c-a89c090ed043 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:25.708595 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eede41d3-6584-49e1-be9c-a89c090ed043 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:25.709614 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eede41d3-6584-49e1-be9c-a89c090ed043 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:25.710244 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eede41d3-6584-49e1-be9c-a89c090ed043 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:25.714877 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:09:25.852723 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eede41d3-6584-49e1-be9c-a89c090ed043 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:25.862139 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eede41d3-6584-49e1-be9c-a89c090ed043 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 200 len: 1508 microversion: 2.1 time: 0.172614 Jul 31 20:09:25.862719 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 585/1166] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:25 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:25.883335 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-00da6867-4e33-43c7-8fae-98c1457d7f0a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b87557f1-7122-4f74-9ce8-8b0107918927", "device": "/dev/sdb"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:09:25.886247 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-00da6867-4e33-43c7-8fae-98c1457d7f0a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:25.888613 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:09:25.894799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00da6867-4e33-43c7-8fae-98c1457d7f0a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:25.895197 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00da6867-4e33-43c7-8fae-98c1457d7f0a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:25.895976 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00da6867-4e33-43c7-8fae-98c1457d7f0a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:25.896408 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00da6867-4e33-43c7-8fae-98c1457d7f0a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:26.373839 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-00da6867-4e33-43c7-8fae-98c1457d7f0a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "POST /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.494142 Jul 31 20:09:26.375157 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 582/1167] 10.222.0.48 () {60 vars in 1323 bytes} [Sun Jul 31 20:09:25 2022] POST /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862/os-volume_attachments => generated 194 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:09:42.753251 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6d3c0a9c-47af-4809-93fc-a31925288f2a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:42.753761 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6d3c0a9c-47af-4809-93fc-a31925288f2a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:42.755697 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:09:42.756492 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:09:42.762097 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d3c0a9c-47af-4809-93fc-a31925288f2a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:42.762540 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d3c0a9c-47af-4809-93fc-a31925288f2a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:42.763288 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d3c0a9c-47af-4809-93fc-a31925288f2a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:42.763715 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d3c0a9c-47af-4809-93fc-a31925288f2a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:43.073523 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-6d3c0a9c-47af-4809-93fc-a31925288f2a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lazy-loading 'services' on Instance uuid d1c12684-359d-4e14-8739-ea462be99862 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:09:43.156812 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6d3c0a9c-47af-4809-93fc-a31925288f2a tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862/os-volume_attachments/b87557f1-7122-4f74-9ce8-8b0107918927" status: 202 len: 0 microversion: 2.1 time: 0.407559 Jul 31 20:09:43.157446 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 586/1168] 10.222.0.48 () {58 vars in 1416 bytes} [Sun Jul 31 20:09:42 2022] DELETE /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862/os-volume_attachments/b87557f1-7122-4f74-9ce8-8b0107918927 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 20:09:44.286386 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:09:44.287449 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 20:09:44.291880 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ee93eb3c-5247-4584-82c5-08b50b418721 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:44.292521 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ee93eb3c-5247-4584-82c5-08b50b418721 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:44.300339 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ee93eb3c-5247-4584-82c5-08b50b418721 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:44.300799 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ee93eb3c-5247-4584-82c5-08b50b418721 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:44.301602 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ee93eb3c-5247-4584-82c5-08b50b418721 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:44.302029 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ee93eb3c-5247-4584-82c5-08b50b418721 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:44.329490 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ee93eb3c-5247-4584-82c5-08b50b418721 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 20:09:44.418164 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ee93eb3c-5247-4584-82c5-08b50b418721 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 204 len: 0 microversion: 2.1 time: 0.133250 Jul 31 20:09:44.419131 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 583/1169] 10.222.0.48 () {58 vars in 1239 bytes} [Sun Jul 31 20:09:44 2022] DELETE /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 20:09:44.430302 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-48456d46-afd9-47df-a23d-0501ef049314 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:44.431481 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-48456d46-afd9-47df-a23d-0501ef049314 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:44.439308 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48456d46-afd9-47df-a23d-0501ef049314 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:44.439804 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48456d46-afd9-47df-a23d-0501ef049314 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:44.440728 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48456d46-afd9-47df-a23d-0501ef049314 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:44.441198 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48456d46-afd9-47df-a23d-0501ef049314 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:44.571003 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-48456d46-afd9-47df-a23d-0501ef049314 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:44.579118 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-48456d46-afd9-47df-a23d-0501ef049314 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 200 len: 1514 microversion: 2.1 time: 0.154902 Jul 31 20:09:44.579775 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 587/1170] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:44 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:45.605961 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a82b359f-125a-44e7-ba3d-157f95cb713f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:45.607118 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a82b359f-125a-44e7-ba3d-157f95cb713f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:45.618070 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a82b359f-125a-44e7-ba3d-157f95cb713f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:45.618794 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a82b359f-125a-44e7-ba3d-157f95cb713f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:45.620032 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a82b359f-125a-44e7-ba3d-157f95cb713f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:45.621222 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a82b359f-125a-44e7-ba3d-157f95cb713f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:45.757991 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a82b359f-125a-44e7-ba3d-157f95cb713f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:45.766354 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a82b359f-125a-44e7-ba3d-157f95cb713f tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 200 len: 1514 microversion: 2.1 time: 0.167666 Jul 31 20:09:45.766984 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 584/1171] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:45 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:46.580300 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-8b51a4fc-1586-41bc-9e4e-6b61f50a685f req-f6699130-e489-408e-a551-3ed17436bda3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c12684-359d-4e14-8739-ea462be99862", "name": "network-vif-deleted", "tag": "590e25b3-f2cb-434c-a84f-5bccc9821924"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 20:09:46.590906 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8b51a4fc-1586-41bc-9e4e-6b61f50a685f req-f6699130-e489-408e-a551-3ed17436bda3 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:46.591339 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8b51a4fc-1586-41bc-9e4e-6b61f50a685f req-f6699130-e489-408e-a551-3ed17436bda3 service nova] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:46.602525 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-8b51a4fc-1586-41bc-9e4e-6b61f50a685f req-f6699130-e489-408e-a551-3ed17436bda3 service nova] Creating event network-vif-deleted:590e25b3-f2cb-434c-a84f-5bccc9821924 for instance d1c12684-359d-4e14-8739-ea462be99862 on hv-cinder-84984 Jul 31 20:09:46.607809 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-8b51a4fc-1586-41bc-9e4e-6b61f50a685f req-f6699130-e489-408e-a551-3ed17436bda3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031176 Jul 31 20:09:46.608401 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 588/1172] 10.222.0.48 () {64 vars in 1317 bytes} [Sun Jul 31 20:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 20:09:46.791182 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-02585dc1-93a2-40b5-a286-3d9365217d29 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:46.791876 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-02585dc1-93a2-40b5-a286-3d9365217d29 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:46.798837 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02585dc1-93a2-40b5-a286-3d9365217d29 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:46.799288 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02585dc1-93a2-40b5-a286-3d9365217d29 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:46.800050 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02585dc1-93a2-40b5-a286-3d9365217d29 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:46.800478 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02585dc1-93a2-40b5-a286-3d9365217d29 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:46.833741 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02585dc1-93a2-40b5-a286-3d9365217d29 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:46.834142 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02585dc1-93a2-40b5-a286-3d9365217d29 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:46.834633 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-02585dc1-93a2-40b5-a286-3d9365217d29 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lazy-loading 'fault' on Instance uuid d1c12684-359d-4e14-8739-ea462be99862 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 20:09:46.876840 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-02585dc1-93a2-40b5-a286-3d9365217d29 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e943453c5734f99bce435117e202b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90341435be0e46008416d3afb9d9cf90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 20:09:46.884698 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-02585dc1-93a2-40b5-a286-3d9365217d29 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 200 len: 1308 microversion: 2.1 time: 0.097566 Jul 31 20:09:46.885303 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 585/1173] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:46 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 20:09:47.912031 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d84da42b-41fd-427d-b24c-fa205f8803b6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 20:09:47.913202 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d84da42b-41fd-427d-b24c-fa205f8803b6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] [instance: d1c12684-359d-4e14-8739-ea462be99862] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 20:09:47.923680 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d84da42b-41fd-427d-b24c-fa205f8803b6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:47.924427 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d84da42b-41fd-427d-b24c-fa205f8803b6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:47.925747 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d84da42b-41fd-427d-b24c-fa205f8803b6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 20:09:47.926473 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d84da42b-41fd-427d-b24c-fa205f8803b6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Lock "cdcc5c53-df39-4ee3-bc4a-be549d4d611a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 20:09:47.940834 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-d84da42b-41fd-427d-b24c-fa205f8803b6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] HTTP exception thrown: Instance d1c12684-359d-4e14-8739-ea462be99862 could not be found. Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d84da42b-41fd-427d-b24c-fa205f8803b6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Request method failure captured: Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 HTTP/1.1 Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Connection: close Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Host: 10.222.0.48 Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi5uEkhpmpZi1lxlTMmwtaIhh7kN020cTKhousTEFc9YEzI-MsrA4nsyCtk9AMKSR1_B6bzzHhywvE2W7p-Auk64GzGEtbPfqfhuYPLYGpcj1KLCUGsgxa_kjgSvseNKeoc8dJWKe2fuf2uwpKqzEPHN43kCQTWJbqUXnYpUyn7p1ckjw Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Id: 90341435be0e46008416d3afb9d9cf90 Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotTestJSON-698827392 Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 31 20:09:47.942495 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 31 20:09:47.944210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/90341435be0e46008416d3afb9d9cf90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/90341435be0e46008416d3afb9d9cf90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_90341435be0e46008416d3afb9d9cf90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/90341435be0e46008416d3afb9d9cf90"}]}] Jul 31 20:09:47.944210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotTestJSON-698827392 Jul 31 20:09:47.944210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 90341435be0e46008416d3afb9d9cf90 Jul 31 20:09:47.944210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-698827392 Jul 31 20:09:47.944210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotTestJSON-698827392-project Jul 31 20:09:47.944210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 31 20:09:47.944210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 31 20:09:47.944210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Id: 1e943453c5734f99bce435117e202b8e Jul 31 20:09:47.944210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotTestJSON-698827392-project Jul 31 20:09:47.944210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: method: > Jul 31 20:09:47.944210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: exception: Instance d1c12684-359d-4e14-8739-ea462be99862 could not be found. Jul 31 20:09:47.944210 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: action_args: {'id': 'd1c12684-359d-4e14-8739-ea462be99862'} Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c12684-359d-4e14-8739-ea462be99862 could not be found. Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 20:09:47.945044 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c12684-359d-4e14-8739-ea462be99862 could not be found. Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c12684-359d-4e14-8739-ea462be99862 could not be found. Jul 31 20:09:47.946391 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 31 20:09:47.947615 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d84da42b-41fd-427d-b24c-fa205f8803b6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] Returning 404 to user: Instance d1c12684-359d-4e14-8739-ea462be99862 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 20:09:47.947615 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d84da42b-41fd-427d-b24c-fa205f8803b6 tempest-VolumesSnapshotTestJSON-698827392 tempest-VolumesSnapshotTestJSON-698827392-project] 10.222.0.48 "GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862" status: 404 len: 111 microversion: 2.1 time: 0.039743 Jul 31 20:09:47.947615 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 589/1174] 10.222.0.48 () {58 vars in 1236 bytes} [Sun Jul 31 20:09:47 2022] GET /compute/v2.1/servers/d1c12684-359d-4e14-8739-ea462be99862 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 20:11:28.461086 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 20:11:28.462122 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Sun Jul 31 20:11:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 20:13:00.484927 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 20:13:00.486222 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Sun Jul 31 20:13:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 20:14:37.432213 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 20:14:37.433289 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Sun Jul 31 20:14:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 20:14:48.039475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 20:14:48.039475 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Sun Jul 31 20:14:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 20:14:48.475069 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 20:14:48.475989 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Sun Jul 31 20:14:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 20:15:13.082781 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 20:15:13.083446 dv-cinder-849846-6-iscsi devstack@n-api.service[117919]: Sun Jul 31 20:15:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 20:15:13.575259 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 20:15:13.576164 dv-cinder-849846-6-iscsi devstack@n-api.service[117920]: Sun Jul 31 20:15:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!